Apr 13 10:54:10 devstack cinder-volume[72742]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 10:54:10 devstack cinder-volume[72742]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 10:54:10 devstack cinder-volume[72742]: we strongly recommend against using it for new projects. Apr 13 10:54:10 devstack cinder-volume[72742]: If you are already using Eventlet, we recommend migrating to a different Apr 13 10:54:10 devstack cinder-volume[72742]: framework. For more detail see Apr 13 10:54:10 devstack cinder-volume[72742]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 10:54:10 devstack cinder-volume[72742]: import eventlet # noqa Apr 13 10:54:11 devstack cinder-volume[72742]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=72742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 10:54:11 devstack cinder-volume[72742]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=72742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 10:54:11 devstack cinder-volume[72742]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=72742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 10:54:12 devstack cinder-volume[72742]: INFO dbcounter [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Registered counter for database cinder Apr 13 10:54:12 devstack cinder-volume[72742]: DEBUG oslo_db.sqlalchemy.engines [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:54:12 devstack cinder-volume[72742]: DEBUG dbcounter [-] [72742] Writer thread running {{(pid=72742) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 10:54:12 devstack cinder-volume[72742]: INFO cinder.rpc [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 10:54:12 devstack cinder-volume[72742]: INFO cinder.rpc [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 10:54:12 devstack cinder-volume[72742]: DEBUG oslo_db.sqlalchemy.engines [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:54:12 devstack cinder-volume[72742]: INFO cinder.volume.manager [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Determined volume DB was empty at startup. Apr 13 10:54:12 devstack cinder-volume[72742]: DEBUG cinder.volume.manager [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=72742) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 10:54:12 devstack cinder-volume[72742]: INFO cinder.volume.manager [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 10:54:12 devstack cinder-volume[72742]: WARNING stevedore.named [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 10:54:12 devstack cinder-volume[72742]: WARNING castellan.key_manager [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 10:54:12 devstack cinder-volume[72742]: WARNING cinder.keymgr.conf_key_mgr [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 10:54:12 devstack cinder-volume[72742]: DEBUG cinder.volume.drivers.lvm [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=72742) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Apr 13 10:54:12 devstack cinder-volume[72742]: DEBUG oslo_concurrency.processutils [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=72742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_concurrency.processutils [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] CMD "cinder-rtstool verify" returned: 0 in 0.311s {{(pid=72742) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_db.sqlalchemy.engines [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:54:13 devstack cinder-volume[72742]: INFO cinder.rpc [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Apr 13 10:54:13 devstack cinder-volume[72742]: INFO cinder.rpc [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Apr 13 10:54:13 devstack cinder-volume[72742]: WARNING stevedore.named [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 10:54:13 devstack cinder-volume[72742]: WARNING castellan.key_manager [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 10:54:13 devstack cinder-volume[72742]: INFO cinder.volume.manager [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Image-volume cache enabled for host devstack@lvmdriver-1. Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_db.sqlalchemy.engines [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:54:13 devstack cinder-volume[72742]: INFO oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Starting 1 workers Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Started child 72854 {{(pid=72742) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Full set of CONF: {{(pid=72742) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] ******************************************************************************** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Configuration options gathered from: {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] ================================================================================ {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] allow_availability_zone_fallback = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] allow_compression_on_image_upload = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] allowed_direct_url_schemes = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] api_rate_limit = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] auth_strategy = keystone {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] az_cache_duration = 3600 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_availability_zone = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_host = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_stats_polling_interval = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backup_api_class = cinder.backup.api.API {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backup_name_template = backup-%s {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backup_use_same_host = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backup_use_temp_snapshot = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] chap_password = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] chap_username = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_internal_tenant_project_id = 0e04c33638b5414c8e6bbdfc1bd00ff3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_internal_tenant_user_id = 46949b6dad294c279e6033e7398bfefc {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cloned_volume_same_az = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cluster = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] compression_format = gzip {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] compute_api_class = cinder.compute.nova.API {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] config_dir = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] config_source = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] control_exchange = openstack {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] debug = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] default_availability_zone = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] default_group_type = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72854]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] default_volume_type = lvmdriver-1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] disk_geometry = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] driver_client_cert = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] driver_client_cert_key = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] driver_data_namespace = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] driver_ssl_cert_path = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] driver_ssl_cert_verify = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] driver_use_ssl = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] enable_force_upload = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] enable_new_services = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] enable_unsupported_driver = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] enabled_backends = ['lvmdriver-1'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] enforce_multipath_for_image_xfer = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] filter_function = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_api_insecure = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_api_servers = ['http://192.168.122.207/image'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_api_ssl_compression = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_ca_certificates_file = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_catalog_info = image:glance:publicURL {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_certfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_keyfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_num_retries = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance_request_timeout = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] goodness_function = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] graceful_shutdown_timeout = 5 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] group_api_class = cinder.group.api.API {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] host = devstack {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_compress_on_upload = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_conversion_address_space_limit = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_conversion_cpu_limit = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_conversion_disable = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_upload_use_cinder_backend = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_upload_use_internal_tenant = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_volume_cache_enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_volume_cache_max_count = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] image_volume_cache_max_size_gb = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] init_host_max_objects_retrieval = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] instance_format = [instance: %(uuid)s] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] iscsi_target_flags = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] iscsi_write_cache = on {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] iser_helper = tgtadm {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] iser_ip_address = 192.168.122.207 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] iser_port = 3260 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_color = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_config_append = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_dir = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_file = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_options = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_rotate_interval = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_rotate_interval_type = days {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] log_rotation_type = none {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] max_age = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] max_logfile_count = 30 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] max_logfile_size_mb = 200 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] max_over_subscription_ratio = 20.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] message_reap_interval = 86400 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] message_ttl = 2592000 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] migration_create_volume_timeout_secs = 300 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] monkey_patch = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] monkey_patch_modules = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] my_ip = 192.168.122.207 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] no_snapshot_gb_quota = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] num_iser_scan_tries = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] num_shell_tries = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] num_volume_device_scan_tries = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] nvmeof_conn_info_version = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] nvmet_ns_id = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] nvmet_port_id = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] osapi_max_limit = 1000 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] osapi_volume_ext_list = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] osapi_volume_listen = 0.0.0.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] osapi_volume_listen_port = 8776 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] osapi_volume_use_ssl = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] osapi_volume_workers = 2 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] per_volume_size_limit = -1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] periodic_fuzzy_delay = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] periodic_interval = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] project_id_regex = [0-9a-f\-]+ {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] public_endpoint = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] publish_errors = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] quota_backup_gigabytes = 1000 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] quota_backups = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] quota_gigabytes = 1000 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] quota_groups = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] quota_snapshots = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] quota_volumes = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] rate_limit_burst = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] rate_limit_except_level = CRITICAL {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] rate_limit_interval = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] reinit_driver_count = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] replication_device = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] report_discard_supported = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] report_interval = 120 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] reservation_clean_interval = 86400 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] reservation_expire = 86400 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] reserved_image_namespaces = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] reserved_percentage = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] rpc_response_timeout = 120 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] run_external_periodic_tasks = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] scst_target_driver = iscsi {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] scst_target_iqn_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_down_time = 720 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] shell_completion = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] snapshot_name_template = snapshot-%s {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] snapshot_same_host = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] split_loggers = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] state_path = /opt/stack/data/cinder {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] storage_availability_zone = nova {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] storage_protocol = iSCSI {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] syslog_log_facility = LOG_USER {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] target_helper = lioadm {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] target_ip_address = 192.168.122.207 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] target_port = 3260 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] target_protocol = iscsi {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] target_secondary_ip_addresses = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] trace_flags = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] transfer_api_class = cinder.transfer.api.API {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] transport_url = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] until_refresh = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] use_chap_auth = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] use_default_quota_class = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] use_journal = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] use_json = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] use_multipath_for_image_xfer = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] use_stderr = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] use_syslog = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] verify_glance_signatures = enabled {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_api_class = cinder.volume.api.API {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_backend_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_clear = zero {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_clear_ionice = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_clear_size = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_copy_bps_limit = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_dd_blocksize = 1M {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72854]: INFO cinder.volume.manager [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Starting volume driver LVMVolumeDriver (3.0.0) Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_name_template = volume-%s {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_service_inithost_offload = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volume_usage_audit_period = month {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] zoning_mode = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_concurrency.disable_process_locking = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.admin_password = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.admin_tenant_name = admin {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.admin_token = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.admin_user = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.auth_admin_prefix = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.auth_port = 35357 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.auth_protocol = https {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.auth_section = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.auth_type = password {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.auth_uri = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.auth_version = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.cache = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.certfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.delay_auth_decision = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.http_connect_timeout = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.identity_uri = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.include_service_catalog = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.insecure = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.interface = public {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.keyfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_password = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcache_username = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.region_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.service_token_roles_required = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.service_type = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.token_cache_time = 300 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.207/identity {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.backend = dogpile.cache.null {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.backend_argument = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.backend_expiration_time = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.config_prefix = cache.oslo {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.debug_cache_backend = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.enable_retry_client = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.enable_socket_keepalive = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.enforce_fips_mode = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.expiration_time = 600 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.hashclient_retry_attempts = 2 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.memcache_dead_retry = 300 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.memcache_pool_maxsize = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.memcache_sasl_enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.password = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.proxies = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.redis_db = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.redis_sentinel_service_name = mymaster {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.redis_server = localhost:6379 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.retry_attempts = 2 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.retry_delay = 0.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.socket_keepalive_count = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.socket_keepalive_idle = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.socket_keepalive_interval = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.socket_timeout = 1.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.tls_allowed_ciphers = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.tls_cafile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.tls_certfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.tls_enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.tls_keyfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cache.username = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] coordination.backend_url = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.asyncio_connection = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.asyncio_slave_connection = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.backend = sqlalchemy {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.connection = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.connection_debug = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.connection_parameters = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.connection_recycle_time = 3600 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.connection_trace = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.db_inc_retry_interval = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.db_max_retries = 20 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.db_max_retry_interval = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.db_retry_interval = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.max_overflow = 50 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.max_pool_size = 5 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.max_retries = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.mysql_wsrep_sync_wait = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.pool_timeout = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.retry_interval = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.slave_connection = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.sqlite_synchronous = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.synchronous_reader = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] database.use_db_reconnect = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.connection_string = messaging:// {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.es_doc_type = notification {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.es_scroll_size = 10000 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.es_scroll_time = 2m {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.filter_error_trace = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.hmac_keys = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.sentinel_service_name = mymaster {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.socket_timeout = 0.1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.trace_requests = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler.trace_sqlalchemy = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler_jaeger.process_tags = {} {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler_jaeger.service_name_prefix = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] profiler_otlp.service_name_prefix = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.enforce_new_defaults = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: WARNING oslo_config.cfg [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.enforce_scope = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.policy_default_rule = default {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.policy_file = policy.yaml {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_policy.remote_timeout = 60.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] privsep_osbrick.group = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] privsep_osbrick.helper_command = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] privsep_osbrick.user = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_sys_admin.group = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_sys_admin.helper_command = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] cinder_sys_admin.user = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.auth_section = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.auth_type = password {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.cafile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.certfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.collect_timing = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.insecure = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.keyfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.send_service_user_token = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.split_loggers = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] service_user.timeout = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.auth_section = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.auth_type = password {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.certfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.collect_timing = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.insecure = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.keyfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.region_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.split_loggers = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] glance.timeout = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.backend_availability_zone = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.chap_password = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.chap_username = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.disk_geometry = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.driver_client_cert = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.driver_client_cert_key = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.driver_data_namespace = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.driver_use_ssl = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.enable_unsupported_driver = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.extra_capabilities = {} {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.filter_function = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.goodness_function = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.iscsi_target_flags = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.iscsi_write_cache = on {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.iser_helper = tgtadm {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.iser_ip_address = 192.168.122.207 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.iser_port = 3260 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.lvm_mirrors = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.lvm_share_target = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.lvm_type = auto {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack sudo[72859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.num_shell_tries = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack sudo[72859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.nvmet_port_id = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.replication_device = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.report_discard_supported = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.reserved_percentage = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.scst_target_driver = iscsi {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.scst_target_iqn_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.storage_protocol = iSCSI {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.target_helper = tgtadm {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.target_ip_address = 192.168.122.207 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.target_port = 3260 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.target_protocol = iscsi {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.trace_flags = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.unique_fqdn_network = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.use_chap_auth = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_backend_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_clear = zero {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_clear_ionice = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_clear_size = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volume_group = cinder-volumes {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_reports.file_event_handler = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_reports.log_dir = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.backend_availability_zone = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.backend_host = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.chap_password = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.chap_username = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.chiscsi_conf = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.disk_geometry = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.driver_client_cert = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.driver_client_cert_key = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.driver_data_namespace = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.driver_use_ssl = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.extra_capabilities = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.filter_function = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.goodness_function = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.iscsi_target_flags = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.iscsi_write_cache = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.iser_helper = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.iser_ip_address = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.iser_port = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.iser_target_prefix = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.lvm_conf_file = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.lvm_mirrors = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.lvm_share_target = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.lvm_type = auto {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.num_shell_tries = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.nvmet_ns_id = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.nvmet_port_id = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.replication_device = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.report_discard_supported = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.reserved_percentage = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.scst_target_driver = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.storage_protocol = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.target_helper = lioadm {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.target_ip_address = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.target_port = 3260 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.target_protocol = iscsi {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.trace_flags = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.unique_fqdn_network = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.use_chap_auth = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_clear = zero {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_clear_ionice = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_clear_size = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] lvmdriver-1.volumes_dir = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.ssl = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.ssl_version = {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_notifications.driver = [] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_notifications.retry = -1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] oslo_messaging_notifications.transport_url = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] key_manager.fixed_key = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.barbican_api_version = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.barbican_endpoint = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.barbican_endpoint_type = public {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.barbican_region_name = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.cafile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.certfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.collect_timing = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.insecure = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.keyfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.number_of_retries = 60 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.retry_delay = 1 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.send_service_user_token = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.split_loggers = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.timeout = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.verify_ssl = True {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican.verify_ssl_path = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.auth_section = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.auth_type = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.cafile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.certfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.collect_timing = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.insecure = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.keyfile = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.split_loggers = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] barbican_service_user.timeout = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.approle_role_id = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.approle_secret_id = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.kv_mountpoint = secret {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.kv_path = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.kv_version = 2 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.namespace = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.root_token_id = **** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.ssl_ca_crt_file = None {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.timeout = 60.0 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.use_ssl = False {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:54:13 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] ******************************************************************************** {{(pid=72742) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 10:54:13 devstack sudo[72859]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.502s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:13 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:13 devstack sudo[72879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:13 devstack sudo[72879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:14 devstack sudo[72879]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:14 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.548s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:14 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 10:54:14 devstack cinder-volume[72854]: INFO cinder.brick.local_dev.lvm [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Apr 13 10:54:14 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:14 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:14 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:14 devstack sudo[73163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:54:14 devstack sudo[73163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:14 devstack sudo[73163]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:14 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.526s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:14 devstack cinder-volume[72854]: DEBUG cinder.brick.local_dev.lvm [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=72854) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Apr 13 10:54:14 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:15 devstack sudo[73349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:15 devstack sudo[73349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:15 devstack sudo[73349]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:15 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.978s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:15 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:15 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:15 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:16 devstack sudo[73505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:16 devstack sudo[73505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:16 devstack sudo[73505]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:16 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.498s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:16 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:16 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.014s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:16 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:16 devstack sudo[73547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Apr 13 10:54:16 devstack sudo[73547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:16 devstack sudo[73547]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:16 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.470s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:16 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:16 devstack sudo[73553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:54:16 devstack sudo[73553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:17 devstack sudo[73553]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:17 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.473s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:17 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:17 devstack sudo[73558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:54:17 devstack sudo[73558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:17 devstack sudo[73558]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:17 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:17 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:17 devstack sudo[73561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:54:17 devstack sudo[73561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:18 devstack sudo[73561]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:18 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.476s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:18 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:18 devstack sudo[73566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:18 devstack sudo[73566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:18 devstack sudo[73566]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:18 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.488s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:18 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:18 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.013s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:18 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:18 devstack sudo[73573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:18 devstack sudo[73573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:19 devstack sudo[73573]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:19 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.465s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:19 devstack cinder-volume[72854]: INFO cinder.volume.drivers.lvm [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Enabling LVM thin provisioning by default because a thin pool exists. Apr 13 10:54:19 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:19 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:19 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:19 devstack sudo[73583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:19 devstack sudo[73583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:19 devstack sudo[73583]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:19 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.508s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:19 devstack cinder-volume[72854]: DEBUG cinder.volume.drivers.lvm [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Updating volume stats {{(pid=72854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 10:54:19 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:19 devstack sudo[73696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:54:19 devstack sudo[73696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:20 devstack sudo[73696]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:20 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:20 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:20 devstack sudo[73699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:54:20 devstack sudo[73699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:20 devstack sudo[73699]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:20 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.451s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:20 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:20 devstack sudo[73846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:20 devstack sudo[73846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:21 devstack sudo[73846]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.416s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:21 devstack sudo[73851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:54:21 devstack sudo[73851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:21 devstack sudo[73851]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.432s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:21 devstack cinder-volume[72854]: INFO cinder.volume.driver [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Driver hasn't implemented _init_vendor_properties() Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG cinder.volume.driver [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=72854) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG oslo_db.sqlalchemy.engines [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=72854) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG dbcounter [-] [72854] Writer thread running {{(pid=72854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG cinder.db.sqlalchemy.api [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Building query based on filter {{(pid=72854) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG cinder.image.image_utils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=72854) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 10:54:21 devstack cinder-volume[72854]: INFO cinder.keymgr.migration [None req-50f8975d-7a85-42b2-bd1f-e6e737e6e885 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG cinder.volume.drivers.lvm [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Updating volume stats {{(pid=72854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 10:54:21 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:21 devstack sudo[73856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:54:21 devstack sudo[73856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:22 devstack sudo[73856]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:22 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:22 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:22 devstack sudo[73859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:54:22 devstack sudo[73859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:22 devstack sudo[73859]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:22 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.479s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:22 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:22 devstack sudo[73866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:22 devstack sudo[73866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:23 devstack sudo[73866]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:23 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.482s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:23 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:23 devstack sudo[73871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:54:23 devstack sudo[73871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:23 devstack cinder-volume[72742]: DEBUG dbcounter [-] [72742] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=72742) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:54:23 devstack sudo[73871]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:23 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.486s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:23 devstack cinder-volume[72854]: DEBUG cinder.manager [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Notifying Schedulers of capabilities ... {{(pid=72854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:54:23 devstack cinder-volume[72854]: INFO cinder.volume.manager [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Driver initialization completed successfully. Apr 13 10:54:23 devstack cinder-volume[72854]: INFO cinder.manager [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Initiating service 2 cleanup Apr 13 10:54:23 devstack cinder-volume[72854]: INFO cinder.manager [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Service 2 cleanup completed. Apr 13 10:54:23 devstack cinder-volume[72854]: DEBUG cinder.service [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Creating RPC server for service cinder-volume {{(pid=72854) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 10:54:23 devstack cinder-volume[72854]: DEBUG cinder.service [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=72854) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 10:54:23 devstack cinder-volume[72854]: INFO cinder.volume.manager [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Apr 13 10:54:23 devstack cinder-volume[72854]: DEBUG cinder.volume.drivers.lvm [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Updating volume stats {{(pid=72854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 10:54:23 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:23 devstack sudo[73877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:54:23 devstack sudo[73877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:24 devstack sudo[73877]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:24 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.493s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:24 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:24 devstack sudo[73881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:54:24 devstack sudo[73881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:24 devstack sudo[73881]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:24 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.456s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:24 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:24 devstack sudo[73989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:54:24 devstack sudo[73989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:25 devstack sudo[73989]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:25 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.422s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:25 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:54:25 devstack sudo[74203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:54:25 devstack sudo[74203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:54:25 devstack sudo[74203]: pam_unix(sudo:session): session closed for user root Apr 13 10:54:25 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.442s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:54:25 devstack cinder-volume[72854]: INFO cinder.volume.manager [None req-a60cf4dc-4926-4eed-acf3-98fa004e877b None None] Driver post RPC initialization completed successfully. Apr 13 10:54:35 devstack cinder-volume[72854]: DEBUG dbcounter [-] [72854] Writing DB stats cinder:SELECT=3 {{(pid=72854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:54:35 devstack cinder-volume[72854]: DEBUG dbcounter [-] [72854] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=72854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:55:31 devstack cinder-volume[72854]: DEBUG oslo_service.periodic_task [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 10:55:31 devstack cinder-volume[72854]: DEBUG cinder.volume.drivers.lvm [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Updating volume stats {{(pid=72854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 10:55:31 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:55:31 devstack sudo[78915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:55:31 devstack sudo[78915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:55:32 devstack sudo[78915]: pam_unix(sudo:session): session closed for user root Apr 13 10:55:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:55:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:55:32 devstack sudo[78919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:55:32 devstack sudo[78919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:55:32 devstack sudo[78919]: pam_unix(sudo:session): session closed for user root Apr 13 10:55:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.433s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:55:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:55:32 devstack sudo[78923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:55:32 devstack sudo[78923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:55:32 devstack sudo[78923]: pam_unix(sudo:session): session closed for user root Apr 13 10:55:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.428s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:55:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:55:32 devstack sudo[78927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:55:32 devstack sudo[78927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:55:33 devstack sudo[78927]: pam_unix(sudo:session): session closed for user root Apr 13 10:55:33 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.465s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:55:33 devstack cinder-volume[72854]: DEBUG cinder.manager [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Notifying Schedulers of capabilities ... {{(pid=72854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:56:31 devstack cinder-volume[72854]: DEBUG oslo_service.periodic_task [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 10:56:31 devstack cinder-volume[72854]: DEBUG cinder.volume.drivers.lvm [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Updating volume stats {{(pid=72854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 10:56:31 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:56:31 devstack sudo[80523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:56:31 devstack sudo[80523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:56:31 devstack sudo[80523]: pam_unix(sudo:session): session closed for user root Apr 13 10:56:31 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.421s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:56:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:56:32 devstack sudo[80561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:56:32 devstack sudo[80561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:56:32 devstack sudo[80561]: pam_unix(sudo:session): session closed for user root Apr 13 10:56:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.457s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:56:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:56:32 devstack sudo[80592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:56:32 devstack sudo[80592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:56:32 devstack sudo[80592]: pam_unix(sudo:session): session closed for user root Apr 13 10:56:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.458s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:56:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:56:32 devstack sudo[80631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:56:32 devstack sudo[80631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:56:33 devstack sudo[80631]: pam_unix(sudo:session): session closed for user root Apr 13 10:56:33 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.466s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:56:33 devstack cinder-volume[72854]: DEBUG cinder.manager [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Notifying Schedulers of capabilities ... {{(pid=72854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:56:35 devstack cinder-volume[72854]: DEBUG dbcounter [-] [72854] Writing DB stats cinder:SELECT=1 {{(pid=72854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:56:35 devstack cinder-volume[72854]: DEBUG dbcounter [-] [72854] Writing DB stats cinder:UPDATE=1 {{(pid=72854) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:57:31 devstack cinder-volume[72854]: DEBUG oslo_service.periodic_task [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=72854) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 10:57:31 devstack cinder-volume[72854]: DEBUG cinder.volume.drivers.lvm [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Updating volume stats {{(pid=72854) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Apr 13 10:57:31 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:31 devstack sudo[81839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Apr 13 10:57:31 devstack sudo[81839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:32 devstack sudo[81839]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.441s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:32 devstack sudo[81842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:57:32 devstack sudo[81842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:32 devstack sudo[81842]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.445s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:32 devstack sudo[81868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Apr 13 10:57:32 devstack sudo[81868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:32 devstack sudo[81868]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.431s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:32 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:32 devstack sudo[81874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Apr 13 10:57:32 devstack sudo[81874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:33 devstack sudo[81874]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:33 devstack cinder-volume[72854]: DEBUG oslo_concurrency.processutils [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.461s {{(pid=72854) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:33 devstack cinder-volume[72854]: DEBUG cinder.manager [None req-0e953afc-0752-412b-8139-16477b48aef4 None None] Notifying Schedulers of capabilities ... {{(pid=72854) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:57:39 devstack cinder-volume[72742]: INFO oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Caught SIGTERM, stopping children Apr 13 10:57:39 devstack cinder-volume[72742]: DEBUG oslo_concurrency.lockutils [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Acquiring lock "singleton_lock" {{(pid=72742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 10:57:39 devstack cinder-volume[72742]: DEBUG oslo_concurrency.lockutils [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Acquired lock "singleton_lock" {{(pid=72742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 10:57:39 devstack cinder-volume[72742]: DEBUG oslo_concurrency.lockutils [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Releasing lock "singleton_lock" {{(pid=72742) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 10:57:39 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Stop services. {{(pid=72742) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 10:57:39 devstack cinder-volume[72742]: DEBUG oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Killing children. {{(pid=72742) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 10:57:39 devstack cinder-volume[72742]: INFO oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Waiting on 1 children to exit Apr 13 10:57:43 devstack cinder-volume[72854]: DEBUG oslo_concurrency.lockutils [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Acquiring lock "singleton_lock" {{(pid=72854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 10:57:43 devstack cinder-volume[72854]: DEBUG oslo_concurrency.lockutils [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Acquired lock "singleton_lock" {{(pid=72854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 10:57:43 devstack cinder-volume[72854]: DEBUG oslo_concurrency.lockutils [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Releasing lock "singleton_lock" {{(pid=72854) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 10:57:43 devstack cinder-volume[72854]: WARNING amqp [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 10:57:43 devstack cinder-volume[72854]: WARNING amqp [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 10:57:43 devstack cinder-volume[72742]: INFO oslo_service.backend._eventlet.service [None req-3892cefe-ccfb-431c-92d2-a2bd4268882b None None] Child 72854 exited with status 0 Apr 13 10:57:43 devstack cinder-volume[82178]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 10:57:43 devstack cinder-volume[82178]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 10:57:43 devstack cinder-volume[82178]: we strongly recommend against using it for new projects. Apr 13 10:57:43 devstack cinder-volume[82178]: If you are already using Eventlet, we recommend migrating to a different Apr 13 10:57:43 devstack cinder-volume[82178]: framework. For more detail see Apr 13 10:57:43 devstack cinder-volume[82178]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 10:57:43 devstack cinder-volume[82178]: import eventlet # noqa Apr 13 10:57:45 devstack cinder-volume[82178]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 10:57:45 devstack cinder-volume[82178]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 10:57:45 devstack cinder-volume[82178]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 10:57:46 devstack cinder-volume[82178]: INFO dbcounter [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Registered counter for database cinder Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_db.sqlalchemy.engines [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG dbcounter [-] [82178] Writer thread running {{(pid=82178) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 10:57:46 devstack cinder-volume[82178]: INFO cinder.rpc [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 10:57:46 devstack cinder-volume[82178]: INFO cinder.rpc [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_db.sqlalchemy.engines [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:57:46 devstack cinder-volume[82178]: INFO cinder.volume.manager [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Determined volume DB was empty at startup. Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG cinder.volume.manager [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82178) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 10:57:46 devstack cinder-volume[82178]: INFO cinder.volume.manager [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Service not found for updating active_backend_id, assuming default for driver init. Apr 13 10:57:46 devstack cinder-volume[82178]: WARNING stevedore.named [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 10:57:46 devstack cinder-volume[82178]: WARNING castellan.key_manager [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 10:57:46 devstack cinder-volume[82178]: WARNING cinder.keymgr.conf_key_mgr [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 10:57:46 devstack cinder-volume[82178]: INFO cinder.volume.manager [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_db.sqlalchemy.engines [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82178) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:57:46 devstack cinder-volume[82178]: INFO oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Starting 1 workers Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Started child 82296 {{(pid=82178) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Full set of CONF: {{(pid=82178) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] ******************************************************************************** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Configuration options gathered from: {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] ================================================================================ {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] allow_availability_zone_fallback = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] allow_compression_on_image_upload = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] allowed_direct_url_schemes = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] api_rate_limit = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] auth_strategy = keystone {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_availability_zone = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_host = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_stats_polling_interval = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backup_api_class = cinder.backup.api.API {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backup_name_template = backup-%s {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backup_use_same_host = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backup_use_temp_snapshot = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] chap_password = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] chap_username = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_internal_tenant_project_id = 0e04c33638b5414c8e6bbdfc1bd00ff3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_internal_tenant_user_id = 46949b6dad294c279e6033e7398bfefc {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cluster = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] compression_format = gzip {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] compute_api_class = cinder.compute.nova.API {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] config_dir = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] config_source = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] control_exchange = openstack {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] debug = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] default_availability_zone = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] default_group_type = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82296]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] default_volume_type = QuobyteHD {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] disk_geometry = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] driver_client_cert = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] driver_client_cert_key = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] driver_data_namespace = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] driver_ssl_cert_path = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] driver_ssl_cert_verify = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] driver_use_ssl = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] enable_new_services = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] enable_unsupported_driver = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] enabled_backends = ['QuobyteHD'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] enforce_multipath_for_image_xfer = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] filter_function = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_api_insecure = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_api_servers = ['http://192.168.122.207/image'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_api_ssl_compression = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_ca_certificates_file = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_catalog_info = image:glance:publicURL {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_certfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_keyfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_num_retries = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance_request_timeout = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] goodness_function = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] graceful_shutdown_timeout = 5 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] group_api_class = cinder.group.api.API {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] host = devstack {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_compress_on_upload = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_conversion_address_space_limit = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_conversion_cpu_limit = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_conversion_disable = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_upload_use_cinder_backend = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_upload_use_internal_tenant = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_volume_cache_enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_volume_cache_max_count = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] image_volume_cache_max_size_gb = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] init_host_max_objects_retrieval = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] instance_format = [instance: %(uuid)s] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] iscsi_target_flags = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] iscsi_write_cache = on {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] iser_helper = tgtadm {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] iser_ip_address = 192.168.122.207 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] iser_port = 3260 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_color = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_config_append = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_dir = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_file = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_options = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_rotate_interval = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_rotate_interval_type = days {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] log_rotation_type = none {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] max_age = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] max_logfile_count = 30 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] max_logfile_size_mb = 200 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] max_over_subscription_ratio = 20.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] message_reap_interval = 86400 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] message_ttl = 2592000 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] migration_create_volume_timeout_secs = 300 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] monkey_patch = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] monkey_patch_modules = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] my_ip = 192.168.122.207 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] no_snapshot_gb_quota = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] num_iser_scan_tries = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] num_shell_tries = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] num_volume_device_scan_tries = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] nvmeof_conn_info_version = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] nvmet_ns_id = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] nvmet_port_id = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] osapi_max_limit = 1000 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] osapi_volume_ext_list = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] osapi_volume_listen_port = 8776 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] osapi_volume_use_ssl = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] osapi_volume_workers = 2 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] per_volume_size_limit = -1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] periodic_fuzzy_delay = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] periodic_interval = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] public_endpoint = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] publish_errors = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] quota_backup_gigabytes = 1000 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] quota_backups = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] quota_gigabytes = 1000 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] quota_groups = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] quota_snapshots = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] quota_volumes = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] rate_limit_burst = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] rate_limit_except_level = CRITICAL {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] rate_limit_interval = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] reinit_driver_count = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] replication_device = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] report_discard_supported = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] report_interval = 120 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] reservation_clean_interval = 86400 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] reservation_expire = 86400 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] reserved_image_namespaces = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] reserved_percentage = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] rpc_response_timeout = 120 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] run_external_periodic_tasks = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] scst_target_driver = iscsi {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] scst_target_iqn_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_down_time = 720 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] shell_completion = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] snapshot_name_template = snapshot-%s {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] split_loggers = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] state_path = /opt/stack/data/cinder {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] storage_availability_zone = nova {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] storage_protocol = iSCSI {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] syslog_log_facility = LOG_USER {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] target_helper = lioadm {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] target_ip_address = 192.168.122.207 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] target_port = 3260 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] target_protocol = iscsi {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] target_secondary_ip_addresses = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] trace_flags = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] transport_url = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] until_refresh = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] use_chap_auth = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] use_default_quota_class = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] use_journal = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] use_json = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] use_multipath_for_image_xfer = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] use_stderr = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] use_syslog = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] verify_glance_signatures = enabled {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_api_class = cinder.volume.api.API {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_backend_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_clear = zero {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_clear_ionice = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_clear_size = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_copy_bps_limit = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_dd_blocksize = 1M {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_name_template = volume-%s {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_service_inithost_offload = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volume_usage_audit_period = month {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] zoning_mode = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_concurrency.disable_process_locking = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.admin_password = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.admin_token = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.admin_user = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.auth_port = 35357 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.auth_protocol = https {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.auth_section = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.auth_type = password {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.auth_uri = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.auth_version = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.cache = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.certfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.identity_uri = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.include_service_catalog = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.insecure = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.interface = public {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.keyfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_password = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcache_username = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.region_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.service_type = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.207/identity {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.backend = dogpile.cache.null {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.backend_argument = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.backend_expiration_time = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.config_prefix = cache.oslo {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.debug_cache_backend = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.enable_retry_client = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.enable_socket_keepalive = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.enforce_fips_mode = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.expiration_time = 600 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.hashclient_retry_attempts = 2 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.memcache_dead_retry = 300 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.memcache_pool_maxsize = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.memcache_sasl_enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.password = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.proxies = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.redis_db = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.redis_server = localhost:6379 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.retry_attempts = 2 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.retry_delay = 0.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.socket_keepalive_count = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.socket_keepalive_idle = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.socket_keepalive_interval = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.socket_timeout = 1.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.tls_allowed_ciphers = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.tls_cafile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.tls_certfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.tls_enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.tls_keyfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cache.username = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] coordination.backend_url = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.asyncio_connection = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.asyncio_slave_connection = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.backend = sqlalchemy {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.connection = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.connection_debug = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.connection_parameters = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.connection_recycle_time = 3600 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.connection_trace = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.db_inc_retry_interval = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.db_max_retries = 20 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.db_max_retry_interval = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.db_retry_interval = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.max_overflow = 50 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.max_pool_size = 5 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.max_retries = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.mysql_wsrep_sync_wait = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.pool_timeout = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.retry_interval = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.slave_connection = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.sqlite_synchronous = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.synchronous_reader = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] database.use_db_reconnect = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.connection_string = messaging:// {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.es_doc_type = notification {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.es_scroll_size = 10000 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.es_scroll_time = 2m {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.filter_error_trace = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.hmac_keys = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.sentinel_service_name = mymaster {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.socket_timeout = 0.1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.trace_requests = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler.trace_sqlalchemy = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler_jaeger.process_tags = {} {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler_jaeger.service_name_prefix = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] profiler_otlp.service_name_prefix = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.enforce_new_defaults = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: WARNING oslo_config.cfg [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.enforce_scope = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.policy_default_rule = default {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.policy_file = policy.yaml {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] privsep_osbrick.group = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] privsep_osbrick.helper_command = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] privsep_osbrick.user = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_sys_admin.group = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_sys_admin.helper_command = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] cinder_sys_admin.user = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.auth_section = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.auth_type = password {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.cafile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.certfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.collect_timing = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.insecure = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.keyfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.send_service_user_token = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.split_loggers = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] service_user.timeout = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.auth_section = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.auth_type = password {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.certfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.collect_timing = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.insecure = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.keyfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.region_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.split_loggers = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] glance.timeout = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.backend_availability_zone = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.chap_password = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.chap_username = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.disk_geometry = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.driver_client_cert = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.driver_client_cert_key = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.driver_data_namespace = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.driver_use_ssl = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.extra_capabilities = {} {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.filter_function = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.goodness_function = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.iscsi_target_flags = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.iscsi_write_cache = on {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.iser_helper = tgtadm {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.iser_ip_address = 192.168.122.207 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.iser_port = 3260 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_host = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_login = admin {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_mount_options = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_password = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_private_key = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_share_path = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.num_shell_tries = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.quobyte_volume_url = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.replication_device = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.report_discard_supported = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.reserved_percentage = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.target_helper = tgtadm {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.target_ip_address = 192.168.122.207 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.target_port = 3260 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.target_protocol = iscsi {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.trace_flags = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.unique_fqdn_network = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.use_chap_auth = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volume_backend_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volume_clear = zero {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volume_clear_ionice = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volume_clear_size = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_reports.file_event_handler = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_reports.log_dir = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.backend_availability_zone = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.backend_host = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.chap_password = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.chap_username = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.chiscsi_conf = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.disk_geometry = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.driver_client_cert = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.driver_data_namespace = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.driver_use_ssl = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.extra_capabilities = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.filter_function = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.goodness_function = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.iser_helper = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.iser_ip_address = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.iser_port = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.iser_target_prefix = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_host = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_login = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_mount_options = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_password = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_private_key = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_share_path = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_ssh_port = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.num_shell_tries = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.nvmet_port_id = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.replication_device = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.report_discard_supported = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.reserved_percentage = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.scst_target_driver = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.storage_protocol = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.target_helper = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.target_ip_address = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.target_port = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.target_prefix = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.target_protocol = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.trace_flags = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.use_chap_auth = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volume_clear = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volume_clear_size = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] QuobyteHD.volumes_dir = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.ssl = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_notifications.driver = [] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_notifications.retry = -1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:46 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] key_manager.fixed_key = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.barbican_api_version = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.barbican_endpoint = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.barbican_endpoint_type = public {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.barbican_region_name = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.cafile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.certfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.collect_timing = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.insecure = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.keyfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82296]: INFO cinder.volume.manager [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.number_of_retries = 60 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.retry_delay = 1 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.send_service_user_token = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.split_loggers = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.timeout = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.verify_ssl = True {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican.verify_ssl_path = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.auth_section = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.auth_type = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.cafile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.certfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.collect_timing = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.insecure = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.keyfile = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.split_loggers = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] barbican_service_user.timeout = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.approle_role_id = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.approle_secret_id = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.kv_mountpoint = secret {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.kv_path = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.kv_version = 2 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.namespace = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.root_token_id = **** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.ssl_ca_crt_file = None {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.timeout = 60.0 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.use_ssl = False {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:47 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] ******************************************************************************** {{(pid=82178) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.remotefs [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82296) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82296) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 10:57:47 devstack cinder-volume[82296]: WARNING cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 10:57:47 devstack cinder-volume[82296]: WARNING cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Running cmd (subprocess): mount.quobyte {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:47 devstack quobyte-client[82297]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 10:57:47 devstack quobyte-client[82297]: Invalid parameters found, error: missing mount point. Apr 13 10:57:47 devstack quobyte-client[82297]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 10:57:47 devstack quobyte-client[82297]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82296) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:57:47 devstack cinder-volume[82296]: INFO cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e ... Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 -c /etc/quobyte/client-cinder.cfg {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:47 devstack sudo[82298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 -c /etc/quobyte/client-cinder.cfg Apr 13 10:57:47 devstack sudo[82298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:47 devstack sudo[82298]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.500s {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:47 devstack cinder-volume[82296]: INFO cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e succeeded Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82296) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.506s {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:57:47 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:47 devstack sudo[82367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:57:47 devstack sudo[82367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:48 devstack sudo[82367]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.377s {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:48 devstack cinder-volume[82296]: INFO cinder.volume.driver [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Driver hasn't implemented _init_vendor_properties() Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.volume.driver [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82296) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_db.sqlalchemy.engines [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82296) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG dbcounter [-] [82296] Writer thread running {{(pid=82296) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.db.sqlalchemy.api [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Building query based on filter {{(pid=82296) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.image.image_utils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82296) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 10:57:48 devstack cinder-volume[82296]: INFO cinder.keymgr.migration [None req-89e6e85a-d526-49f4-bf81-05a5f75b4cf3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82296) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82296) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:48 devstack sudo[82370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:57:48 devstack sudo[82370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:48 devstack sudo[82370]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.385s {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.manager [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Notifying Schedulers of capabilities ... {{(pid=82296) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:57:48 devstack cinder-volume[82296]: INFO cinder.volume.manager [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Driver initialization completed successfully. Apr 13 10:57:48 devstack cinder-volume[82296]: INFO cinder.manager [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Initiating service 3 cleanup Apr 13 10:57:48 devstack cinder-volume[82296]: INFO cinder.manager [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Service 3 cleanup completed. Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.service [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Creating RPC server for service cinder-volume {{(pid=82296) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.service [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82296) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 10:57:48 devstack cinder-volume[82296]: INFO cinder.volume.manager [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82296) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82296) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:48 devstack sudo[82375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:57:48 devstack sudo[82375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:48 devstack sudo[82375]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:48 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.412s {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:48 devstack cinder-volume[82296]: INFO cinder.volume.manager [None req-566b88ea-51a1-43b1-8033-27dd6f40a83c None None] Driver post RPC initialization completed successfully. Apr 13 10:57:51 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-0079bb35-818c-4b63-b481-76f6c2456c73 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:57:51 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-0079bb35-818c-4b63-b481-76f6c2456c73 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:57:51 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-0079bb35-818c-4b63-b481-76f6c2456c73 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82296) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:57:51 devstack cinder-volume[82296]: DEBUG cinder.volume.drivers.quobyte [None req-0079bb35-818c-4b63-b481-76f6c2456c73 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82296) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:57:51 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-0079bb35-818c-4b63-b481-76f6c2456c73 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82296) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:57:51 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-0079bb35-818c-4b63-b481-76f6c2456c73 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:57:52 devstack sudo[82442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:57:52 devstack sudo[82442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:57:52 devstack sudo[82442]: pam_unix(sudo:session): session closed for user root Apr 13 10:57:52 devstack cinder-volume[82296]: DEBUG oslo_concurrency.processutils [None req-0079bb35-818c-4b63-b481-76f6c2456c73 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.374s {{(pid=82296) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:57:52 devstack cinder-volume[82296]: DEBUG cinder.manager [None req-0079bb35-818c-4b63-b481-76f6c2456c73 None None] Notifying Schedulers of capabilities ... {{(pid=82296) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:57:55 devstack cinder-volume[82178]: INFO oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Caught SIGTERM, stopping children Apr 13 10:57:55 devstack cinder-volume[82178]: DEBUG oslo_concurrency.lockutils [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Acquiring lock "singleton_lock" {{(pid=82178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 10:57:55 devstack cinder-volume[82178]: DEBUG oslo_concurrency.lockutils [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Acquired lock "singleton_lock" {{(pid=82178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 10:57:55 devstack cinder-volume[82178]: DEBUG oslo_concurrency.lockutils [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Releasing lock "singleton_lock" {{(pid=82178) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 10:57:55 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Stop services. {{(pid=82178) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:611}} Apr 13 10:57:55 devstack cinder-volume[82178]: DEBUG oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Killing children. {{(pid=82178) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:616}} Apr 13 10:57:55 devstack cinder-volume[82178]: INFO oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Waiting on 1 children to exit Apr 13 10:57:56 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Acquiring lock "singleton_lock" {{(pid=82296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 10:57:56 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Acquired lock "singleton_lock" {{(pid=82296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 10:57:56 devstack cinder-volume[82296]: DEBUG oslo_concurrency.lockutils [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Releasing lock "singleton_lock" {{(pid=82296) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 10:57:56 devstack cinder-volume[82296]: WARNING amqp [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 10:57:56 devstack cinder-volume[82296]: WARNING amqp [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Received method (60, 30) during closing channel 1. This method will be ignored Apr 13 10:57:56 devstack cinder-volume[82178]: INFO oslo_service.backend._eventlet.service [None req-45ddbad8-b794-4939-bea2-991f803d4f06 None None] Child 82296 exited with status 0 Apr 13 10:57:57 devstack cinder-volume[82517]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Apr 13 10:57:57 devstack cinder-volume[82517]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 10:57:57 devstack cinder-volume[82517]: we strongly recommend against using it for new projects. Apr 13 10:57:57 devstack cinder-volume[82517]: If you are already using Eventlet, we recommend migrating to a different Apr 13 10:57:57 devstack cinder-volume[82517]: framework. For more detail see Apr 13 10:57:57 devstack cinder-volume[82517]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 10:57:57 devstack cinder-volume[82517]: import eventlet # noqa Apr 13 10:57:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82517) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:390}} Apr 13 10:57:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82517) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:393}} Apr 13 10:57:58 devstack cinder-volume[82517]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82517) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:413}} Apr 13 10:57:59 devstack cinder-volume[82517]: INFO dbcounter [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Registered counter for database cinder Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_db.sqlalchemy.engines [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writer thread running {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 10:57:59 devstack cinder-volume[82517]: INFO cinder.rpc [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Apr 13 10:57:59 devstack cinder-volume[82517]: INFO cinder.rpc [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_db.sqlalchemy.engines [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:57:59 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Determined volume DB was empty at startup. Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG cinder.volume.manager [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82517) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}} Apr 13 10:57:59 devstack cinder-volume[82517]: WARNING stevedore.named [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Apr 13 10:57:59 devstack cinder-volume[82517]: WARNING castellan.key_manager [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 10:57:59 devstack cinder-volume[82517]: WARNING cinder.keymgr.conf_key_mgr [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Apr 13 10:57:59 devstack cinder-volume[82517]: INFO cinder.volume.manager [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Image-volume cache disabled for host devstack@QuobyteHD. Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_db.sqlalchemy.engines [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82517) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:57:59 devstack cinder-volume[82517]: INFO oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Starting 1 workers Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Started child 82656 {{(pid=82517) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:491}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Full set of CONF: {{(pid=82517) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:565}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] ******************************************************************************** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2979}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Configuration options gathered from: {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2980}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2981}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2982}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] ================================================================================ {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2987}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] allow_availability_zone_fallback = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] allow_compression_on_image_upload = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] allowed_direct_url_schemes = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] api_rate_limit = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] auth_strategy = keystone {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_availability_zone = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_host = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_stats_polling_interval = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backup_api_class = cinder.backup.api.API {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82656]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backup_name_template = backup-%s {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backup_use_same_host = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backup_use_temp_snapshot = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] chap_password = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] chap_username = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_internal_tenant_project_id = 0e04c33638b5414c8e6bbdfc1bd00ff3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_internal_tenant_user_id = 46949b6dad294c279e6033e7398bfefc {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cluster = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] compression_format = gzip {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] compute_api_class = cinder.compute.nova.API {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] config_dir = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] config_source = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] control_exchange = openstack {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] debug = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] default_availability_zone = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] default_group_type = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] default_volume_type = QuobyteHD {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] disk_geometry = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] driver_client_cert = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] driver_client_cert_key = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] driver_data_namespace = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] driver_ssl_cert_path = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] driver_ssl_cert_verify = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] driver_use_ssl = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] enable_new_services = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] enable_unsupported_driver = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] enabled_backends = ['QuobyteHD'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] enforce_multipath_for_image_xfer = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] filter_function = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_api_insecure = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_api_servers = ['http://192.168.122.207/image'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_api_ssl_compression = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_ca_certificates_file = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_catalog_info = image:glance:publicURL {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_certfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_keyfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_num_retries = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance_request_timeout = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] goodness_function = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] graceful_shutdown_timeout = 5 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] group_api_class = cinder.group.api.API {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] host = devstack {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_compress_on_upload = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_conversion_address_space_limit = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_conversion_cpu_limit = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_conversion_disable = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_upload_use_cinder_backend = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_upload_use_internal_tenant = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_volume_cache_enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_volume_cache_max_count = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] image_volume_cache_max_size_gb = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] init_host_max_objects_retrieval = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] instance_format = [instance: %(uuid)s] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] iscsi_target_flags = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] iscsi_write_cache = on {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] iser_helper = tgtadm {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] iser_ip_address = 192.168.122.207 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] iser_port = 3260 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_color = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_config_append = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_dir = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_file = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_options = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_rotate_interval = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_rotate_interval_type = days {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] log_rotation_type = none {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] max_age = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] max_logfile_count = 30 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] max_logfile_size_mb = 200 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] max_over_subscription_ratio = 20.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] message_reap_interval = 86400 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] message_ttl = 2592000 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] migration_create_volume_timeout_secs = 300 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] monkey_patch = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] monkey_patch_modules = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] my_ip = 192.168.122.207 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] no_snapshot_gb_quota = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] num_iser_scan_tries = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] num_shell_tries = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] num_volume_device_scan_tries = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] nvmeof_conn_info_version = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] nvmet_ns_id = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] nvmet_port_id = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] osapi_max_limit = 1000 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] osapi_volume_ext_list = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] osapi_volume_listen_port = 8776 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] osapi_volume_use_ssl = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] osapi_volume_workers = 2 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] per_volume_size_limit = -1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] periodic_fuzzy_delay = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] periodic_interval = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] public_endpoint = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] publish_errors = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] quota_backup_gigabytes = 1000 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] quota_backups = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] quota_gigabytes = 1000 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] quota_groups = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] quota_snapshots = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] quota_volumes = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] rate_limit_burst = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] rate_limit_except_level = CRITICAL {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] rate_limit_interval = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] reinit_driver_count = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] replication_device = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] report_discard_supported = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] report_interval = 120 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] reservation_clean_interval = 86400 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] reservation_expire = 86400 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] reserved_image_namespaces = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] reserved_percentage = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] rpc_response_timeout = 120 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] run_external_periodic_tasks = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] scst_target_driver = iscsi {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] scst_target_iqn_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_down_time = 720 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] shell_completion = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] snapshot_name_template = snapshot-%s {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] split_loggers = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] state_path = /opt/stack/data/cinder {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] storage_availability_zone = nova {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] storage_protocol = iSCSI {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] syslog_log_facility = LOG_USER {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] target_helper = lioadm {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] target_ip_address = 192.168.122.207 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] target_port = 3260 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] target_protocol = iscsi {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] target_secondary_ip_addresses = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] trace_flags = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] transport_url = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] until_refresh = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] use_chap_auth = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] use_default_quota_class = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] use_journal = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] use_json = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] use_multipath_for_image_xfer = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] use_stderr = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] use_syslog = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] verify_glance_signatures = enabled {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_api_class = cinder.volume.api.API {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_backend_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_clear = zero {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_clear_ionice = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_clear_size = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Starting volume driver QuobyteDriver (1.1.14) Apr 13 10:57:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=82656) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_copy_bps_limit = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_dd_blocksize = 1M {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_name_template = volume-%s {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_service_inithost_offload = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volume_usage_audit_period = month {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] zoning_mode = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2995}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_concurrency.disable_process_locking = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.admin_password = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.admin_tenant_name = admin {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.admin_token = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.admin_user = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.auth_admin_prefix = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.auth_port = 35357 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.auth_protocol = https {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.auth_section = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.auth_type = password {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.auth_uri = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.auth_version = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.cache = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.certfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.identity_uri = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.include_service_catalog = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.insecure = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.interface = public {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.keyfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_password = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcache_username = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.region_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.service_token_roles_required = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.service_type = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.207/identity {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.backend = dogpile.cache.null {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.backend_argument = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.backend_expiration_time = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.config_prefix = cache.oslo {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.debug_cache_backend = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.enable_retry_client = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.enable_socket_keepalive = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.enforce_fips_mode = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.expiration_time = 600 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.hashclient_retry_attempts = 2 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.memcache_dead_retry = 300 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.memcache_pool_maxsize = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.memcache_sasl_enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.password = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.proxies = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.redis_db = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.redis_server = localhost:6379 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.retry_attempts = 2 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.retry_delay = 0.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.socket_keepalive_count = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.socket_keepalive_idle = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.socket_keepalive_interval = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.socket_timeout = 1.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.tls_allowed_ciphers = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.tls_cafile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.tls_certfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.tls_enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.tls_keyfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cache.username = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] coordination.backend_url = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.asyncio_connection = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.asyncio_slave_connection = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.backend = sqlalchemy {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.connection = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.connection_debug = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.connection_parameters = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.connection_recycle_time = 3600 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.connection_trace = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.db_inc_retry_interval = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.db_max_retries = 20 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.db_max_retry_interval = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.db_retry_interval = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.max_overflow = 50 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.max_pool_size = 5 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.max_retries = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.mysql_wsrep_sync_wait = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.pool_timeout = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.retry_interval = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.slave_connection = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.sqlite_synchronous = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.synchronous_reader = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] database.use_db_reconnect = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.connection_string = messaging:// {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.es_doc_type = notification {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.es_scroll_size = 10000 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.es_scroll_time = 2m {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.filter_error_trace = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.hmac_keys = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.sentinel_service_name = mymaster {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.socket_timeout = 0.1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.trace_requests = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler.trace_sqlalchemy = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler_jaeger.process_tags = {} {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler_jaeger.service_name_prefix = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] profiler_otlp.service_name_prefix = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.enforce_new_defaults = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: WARNING oslo_config.cfg [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.enforce_scope = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.policy_default_rule = default {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.policy_file = policy.yaml {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] privsep_osbrick.group = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] privsep_osbrick.helper_command = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] privsep_osbrick.user = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_sys_admin.group = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_sys_admin.helper_command = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] cinder_sys_admin.user = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.auth_section = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.auth_type = password {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.cafile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.certfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.collect_timing = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.insecure = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.keyfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.send_service_user_token = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.split_loggers = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] service_user.timeout = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.auth_section = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.auth_type = password {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.certfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.collect_timing = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.insecure = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.keyfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.region_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.split_loggers = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] glance.timeout = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.backend_availability_zone = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.chap_password = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.chap_username = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.disk_geometry = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.driver_client_cert = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.driver_client_cert_key = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.driver_data_namespace = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.driver_use_ssl = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.extra_capabilities = {} {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.filter_function = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.goodness_function = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=82656) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.iscsi_target_flags = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.iscsi_write_cache = on {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.iser_helper = tgtadm {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.iser_ip_address = 192.168.122.207 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.iser_port = 3260 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_host = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Apr 13 10:57:59 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_login = admin {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_mount_options = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_password = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_private_key = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:57:59 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_share_path = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_ssh_port = 22 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.num_shell_tries = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.quobyte_client_cfg = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.quobyte_volume_url = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.replication_device = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.report_discard_supported = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.reserved_percentage = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Running cmd (subprocess): mount.quobyte {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.target_helper = tgtadm {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.target_ip_address = 192.168.122.207 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.target_port = 3260 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.target_protocol = iscsi {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.trace_flags = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.unique_fqdn_network = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.use_chap_auth = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volume_backend_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volume_clear = zero {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volume_clear_ionice = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volume_clear_size = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_reports.file_event_handler = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_reports.log_dir = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.backend_availability_zone = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.backend_host = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.chap_password = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.chap_username = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.chiscsi_conf = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.disk_geometry = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.driver_client_cert = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.driver_client_cert_key = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.driver_data_namespace = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.driver_use_ssl = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.extra_capabilities = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.filter_function = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.goodness_function = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.iscsi_target_flags = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.iscsi_write_cache = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.iser_helper = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.iser_ip_address = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.iser_port = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.iser_target_prefix = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_host = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_login = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_mount_options = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_password = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_private_key = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_share_path = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_ssh_port = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.num_shell_tries = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nvmet_ns_id = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.nvmet_port_id = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.replication_device = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.report_discard_supported = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.reserved_percentage = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.scst_target_driver = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.storage_protocol = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.target_helper = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.target_ip_address = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.target_port = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.target_prefix = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.target_protocol = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.trace_flags = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.unique_fqdn_network = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.use_chap_auth = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volume_clear = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volume_clear_ionice = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volume_clear_size = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] QuobyteHD.volumes_dir = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack quobyte-client[82665]: Reading configuration file: /etc/quobyte/client.cfg Apr 13 10:58:00 devstack quobyte-client[82665]: Invalid parameters found, error: missing mount point. Apr 13 10:58:00 devstack quobyte-client[82665]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Apr 13 10:58:00 devstack quobyte-client[82665]: Failed to parse all commandline parameters, please use -h/--help to see available options. Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] CMD "mount.quobyte" returned: 1 in 0.115s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.ssl = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_notifications.driver = [] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_notifications.retry = -1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] key_manager.fixed_key = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack sudo[82670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.barbican_api_version = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.barbican_endpoint = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack sudo[82670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.barbican_endpoint_type = public {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.barbican_region_name = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.cafile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.certfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.collect_timing = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.insecure = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.keyfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.number_of_retries = 60 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.retry_delay = 1 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.send_service_user_token = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.split_loggers = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.timeout = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.verify_ssl = True {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican.verify_ssl_path = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.auth_section = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.auth_type = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.cafile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.certfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.collect_timing = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.insecure = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.keyfile = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.split_loggers = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] barbican_service_user.timeout = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.approle_role_id = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.approle_secret_id = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.kv_mountpoint = secret {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.kv_path = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.kv_version = 2 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.namespace = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.root_token_id = **** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.ssl_ca_crt_file = None {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.timeout = 60.0 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.use_ssl = False {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3006}} Apr 13 10:58:00 devstack cinder-volume[82517]: DEBUG oslo_service.backend._eventlet.service [None req-b4d6ac54-a2d6-4c8e-82a5-402793e0dc21 None None] ******************************************************************************** {{(pid=82517) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:3013}} Apr 13 10:58:00 devstack sudo[82670]: pam_unix(sudo:session): session closed for user root Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.457s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:58:00 devstack cinder-volume[82656]: INFO cinder.volume.driver [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Driver hasn't implemented _init_vendor_properties() Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG cinder.volume.driver [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82656) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:873}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_db.sqlalchemy.engines [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82656) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:325}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writer thread running {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG cinder.db.sqlalchemy.api [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Building query based on filter {{(pid=82656) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3943}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82656) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1298}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:58:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:58:00 devstack cinder-volume[82656]: INFO cinder.keymgr.migration [None req-ef0be3ae-eadb-4279-9300-35f931ced2e5 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Apr 13 10:58:00 devstack sudo[82737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:58:00 devstack sudo[82737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:58:01 devstack sudo[82737]: pam_unix(sudo:session): session closed for user root Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.460s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:58:01 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Driver initialization completed successfully. Apr 13 10:58:01 devstack cinder-volume[82656]: INFO cinder.manager [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Initiating service 3 cleanup Apr 13 10:58:01 devstack cinder-volume[82656]: INFO cinder.manager [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Service 3 cleanup completed. Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG cinder.service [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Creating RPC server for service cinder-volume {{(pid=82656) start /opt/stack/cinder/cinder/service.py:231}} Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG cinder.service [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82656) start /opt/stack/cinder/cinder/service.py:237}} Apr 13 10:58:01 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:58:01 devstack sudo[82763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:58:01 devstack sudo[82763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:58:01 devstack sudo[82763]: pam_unix(sudo:session): session closed for user root Apr 13 10:58:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.416s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:58:01 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5c2e7f0d-6494-45b5-97dd-53a434f25b00 None None] Driver post RPC initialization completed successfully. Apr 13 10:58:09 devstack cinder-volume[82517]: DEBUG dbcounter [-] [82517] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=82517) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:58:11 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=1 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:58:11 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Flow 'volume_create_manager' (bae0b6fa-2b43-49a0-895f-f87da7f97138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a81ad2a-1249-404c-9461-80802cd2cec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a81ad2a-1249-404c-9461-80802cd2cec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1714415649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e298ed72713b49cb9466720541d5bd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:01Z,use_quota=True,user_id='d7910cd0e7a945cd974248efd100c267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ef3c1e-02d4-4ac0-82d1-ddfd6536efde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ef3c1e-02d4-4ac0-82d1-ddfd6536efde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4cad1e-aec8-4fe1-98e1-e12e4906e96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e4cad1e-aec8-4fe1-98e1-e12e4906e96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c', 'volume_name': 'volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5e87b3-4a71-4de2-afac-768ec7ac1bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d5e87b3-4a71-4de2-afac-768ec7ac1bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61204b9-0b2e-4dc9-b01e-1fb5f935016c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:01 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Volume c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c', 'volume_size': 1} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:58:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1714415649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e298ed72713b49cb9466720541d5bd46',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:01Z,use_quota=True,user_id='d7910cd0e7a945cd974248efd100c267',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Creating volume c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 10:59:01 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 10:59:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:01 devstack sudo[83159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c 1073741824 Apr 13 10:59:01 devstack sudo[83159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:02 devstack sudo[83159]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c 1073741824" returned: 0 in 1.149s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 10:59:02 devstack sudo[83486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c Apr 13 10:59:02 devstack sudo[83486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Flow 'volume_create_manager' (b3922451-1657-4c07-87b6-4181fa090424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06115d1-3e56-4588-8078-3b07d5ad5a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e06115d1-3e56-4588-8078-3b07d5ad5a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1621626948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a4e2f2-cb5c-48e2-abad-e8389d6cfb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8dac3d547548b3b0760f26d6413f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:03Z,use_quota=True,user_id='f89482d1b1a544949e3fde8a06a848fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247668d0-c4ca-4dfc-8475-36a8b3f7ded9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (247668d0-c4ca-4dfc-8475-36a8b3f7ded9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65615b5d-91d7-4dcb-bdc0-0ac7b0bf057c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65615b5d-91d7-4dcb-bdc0-0ac7b0bf057c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28a4e2f2-cb5c-48e2-abad-e8389d6cfb57', 'volume_name': 'volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34632c58-a55b-4992-927f-7dfb493f0faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34632c58-a55b-4992-927f-7dfb493f0faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd80d55-32e3-4003-81c2-a70b54212dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:02 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Volume 28a4e2f2-cb5c-48e2-abad-e8389d6cfb57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57', 'volume_size': 1} Apr 13 10:59:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:03 devstack sudo[83486]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" returned: 0 in 0.802s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] <== create_volume: return (1997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1621626948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28a4e2f2-cb5c-48e2-abad-e8389d6cfb57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de8dac3d547548b3b0760f26d6413f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:03Z,use_quota=True,user_id='f89482d1b1a544949e3fde8a06a848fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Creating volume 28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 10:59:03 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e61204b9-0b2e-4dc9-b01e-1fb5f935016c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abd6a82-feb2-4957-a160-c6b363360a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:03 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Volume volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c (c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c): created successfully Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9abd6a82-feb2-4957-a160-c6b363360a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:03 devstack sudo[83514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 1073741824 Apr 13 10:59:03 devstack sudo[83514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Flow 'volume_create_manager' (bae0b6fa-2b43-49a0-895f-f87da7f97138) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-77cfae2d-6939-45bf-b56f-1019cd91c672 req-b105d7d6-0c30-4bde-9fed-db616ea0bf71 tempest-VolumesSnapshotsTestJSON-34030532 None] Created volume successfully. Apr 13 10:59:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:04 devstack sudo[83514]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 1073741824" returned: 0 in 1.079s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:04 devstack sudo[83519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 Apr 13 10:59:04 devstack sudo[83519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:05 devstack sudo[83519]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57" returned: 0 in 0.573s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] <== create_volume: return (1677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.048s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd80d55-32e3-4003-81c2-a70b54212dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53970cac-a382-4c31-bd60-10edf3c2921c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Creating offline snapshot cccc3874-147c-42ac-b42c-6ba1b978a663 of volume c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 10:59:05 devstack cinder-volume[82656]: INFO oslo.privsep.daemon [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpnx0n1cny/privsep.sock'] Apr 13 10:59:05 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Volume volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 (28a4e2f2-cb5c-48e2-abad-e8389d6cfb57): created successfully Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53970cac-a382-4c31-bd60-10edf3c2921c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Flow 'volume_create_manager' (b3922451-1657-4c07-87b6-4181fa090424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-68be5ab1-521e-40a0-91fe-0ec6a837179d tempest-VolumesAdminNegativeTest-1497225429 None] Created volume successfully. Apr 13 10:59:05 devstack sudo[83523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpnx0n1cny/privsep.sock Apr 13 10:59:05 devstack sudo[83523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 10:59:06 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Apr 13 10:59:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Acquiring lock "cinder-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Lock "cinder-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Acquiring lock "cinder-quobyte-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Lock "cinder-quobyte-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57" acquired by "delete_volume" :: waited 0.038s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:66: EventletDeprecationWarning: Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Apr 13 10:59:07 devstack sudo[83523]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:07 devstack cinder-volume[82656]: INFO oslo.privsep.daemon [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Spawned new privsep daemon via rootwrap Apr 13 10:59:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Accepted privsep connection to /tmp/tmpnx0n1cny/privsep.sock {{(pid=82656) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:418}} Apr 13 10:59:07 devstack cinder-volume[82656]: INFO oslo.privsep.daemon [-] privsep daemon starting Apr 13 10:59:07 devstack cinder-volume[82656]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Apr 13 10:59:07 devstack cinder-volume[82656]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Apr 13 10:59:07 devstack cinder-volume[82656]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83533 Apr 13 10:59:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a40ff02-1020-45ff-9665-96a4cf204774]: (2,) {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:07 devstack cinder-volume[82656]: WARNING oslo_privsep.priv_context [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] privsep daemon already running Apr 13 10:59:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fbd6386-7a18-47b2-80c1-78031c58f2ff]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f727e62f-4d44-4049-9d19-6ac5fb47a7d4]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:07 devstack sudo[83539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c Apr 13 10:59:07 devstack sudo[83539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:07 devstack sudo[83538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 Apr 13 10:59:07 devstack sudo[83538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:09 devstack sudo[83539]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" returned: 0 in 1.533s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:09 devstack sudo[83560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 1G Apr 13 10:59:09 devstack sudo[83560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:09 devstack sudo[83538]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57" returned: 0 in 1.931s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:09 devstack sudo[83566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57 Apr 13 10:59:09 devstack sudo[83566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:10 devstack sudo[83566]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57" returned: 0 in 1.239s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Lock "cinder-quobyte-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57" released by "delete_volume" :: held 4.151s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:11 devstack cinder-volume[82656]: WARNING cinder.quota [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 10:59:11 devstack cinder-volume[82656]: WARNING cinder.quota [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Created reservations ['6a3081f8-d7a8-4d5f-826f-8a84c81d822c', '0e4c27f9-47a4-4e39-ab89-b53e750d79fa', 'd9591ee4-84a8-4a02-9435-66d466886f11', '34b13642-5da0-498d-87a8-72a806750dcc'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:11 devstack sudo[83576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:59:11 devstack sudo[83576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:11 devstack sudo[83560]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 1G" returned: 0 in 2.274s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:11 devstack sudo[83580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 Apr 13 10:59:11 devstack sudo[83580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:12 devstack sudo[83576]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.145s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:12 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:59:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Deleted volume successfully. Apr 13 10:59:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e635bb93-c9f9-4b22-bee7-db91deccdfea tempest-VolumesAdminNegativeTest-1497225429 None] Lock "cinder-28a4e2f2-cb5c-48e2-abad-e8389d6cfb57-delete_volume" released by "delete_volume" :: held 5.716s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:12 devstack sudo[83580]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663" returned: 0 in 1.268s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:12 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 is being set with open permissions: ugo+rw Apr 13 10:59:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:12 devstack sudo[83607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 Apr 13 10:59:12 devstack sudo[83607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:13 devstack sudo[83607]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663" returned: 0 in 0.536s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:13 devstack sudo[83612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.info Apr 13 10:59:13 devstack sudo[83612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:13 devstack sudo[83612]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.info" returned: 0 in 0.566s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:13 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.info is being set with open permissions: ugo+rw Apr 13 10:59:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:14 devstack sudo[83617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.info Apr 13 10:59:14 devstack sudo[83617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:14 devstack sudo[83617]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.info" returned: 0 in 0.640s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 9.283s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:14 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-234c675f-d3f7-482b-ba35-8d2234d45ca9 req-cfea69bb-d0fb-4a7e-8ea3-ce5c224b2f8b tempest-VolumesSnapshotsTestJSON-34030532 None] Create snapshot completed successfully Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "cinder-cccc3874-147c-42ac-b42c-6ba1b978a663-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-cccc3874-147c-42ac-b42c-6ba1b978a663-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "cinder-quobyte-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-quobyte-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" acquired by "delete_snapshot" :: waited 0.042s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "cinder-quobyte-cccc3874-147c-42ac-b42c-6ba1b978a663" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-quobyte-cccc3874-147c-42ac-b42c-6ba1b978a663" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Deleting offline snapshot cccc3874-147c-42ac-b42c-6ba1b978a663 of volume c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] snapshot_file for this snap is: volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500ead3-3634-404c-9e78-15768993f9f2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:16 devstack sudo[83625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 Apr 13 10:59:16 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Flow 'volume_create_manager' (e26ef1e8-a5f1-44b3-a384-2fe6d0ad8dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac01261a-524f-49e0-ba27-97863c86b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac01261a-524f-49e0-ba27-97863c86b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:17Z,deleted=False,deleted_at=None,display_description='',display_name='edad4e9a-4e6b-46ec-9683-04fea7e05090-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f2d29e-2411-4040-a5c2-e4579143944e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3c67c065974df5a71d3d42a7c5e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:17Z,use_quota=True,user_id='04d2224e74f74c74af3ec395f8347183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067f513c-6a57-4b69-90a1-670fbe297ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (067f513c-6a57-4b69-90a1-670fbe297ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4645908b-8694-4d32-8d4c-bb5d3099da17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4645908b-8694-4d32-8d4c-bb5d3099da17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39f2d29e-2411-4040-a5c2-e4579143944e', 'volume_name': 'volume-39f2d29e-2411-4040-a5c2-e4579143944e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877dcddc-efeb-46ce-9d6d-b15e1e093712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (877dcddc-efeb-46ce-9d6d-b15e1e093712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cf43aa-6bf0-4c06-a621-9982174b7e28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:16 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Volume 39f2d29e-2411-4040-a5c2-e4579143944e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39f2d29e-2411-4040-a5c2-e4579143944e', 'volume_size': 1} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:17Z,deleted=False,deleted_at=None,display_description='',display_name='edad4e9a-4e6b-46ec-9683-04fea7e05090-blank-vol',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f2d29e-2411-4040-a5c2-e4579143944e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3c67c065974df5a71d3d42a7c5e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:17Z,use_quota=True,user_id='04d2224e74f74c74af3ec395f8347183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Creating volume 39f2d29e-2411-4040-a5c2-e4579143944e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 10:59:16 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 10:59:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:17 devstack sudo[83634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e 1073741824 Apr 13 10:59:17 devstack sudo[83634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:17 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663" returned: 0 in 0.746s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 10:59:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[871ea4ed-c5bd-4630-bae8-8d644ee106d4]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:17 devstack sudo[83637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c Apr 13 10:59:17 devstack sudo[83637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:17 devstack sudo[83637]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" returned: 0 in 0.608s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:17 devstack sudo[83634]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e 1073741824" returned: 0 in 0.697s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:17 devstack sudo[83648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 Apr 13 10:59:17 devstack sudo[83648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:17 devstack sudo[83650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e Apr 13 10:59:17 devstack sudo[83650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:18 devstack sudo[83650]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e" returned: 0 in 0.531s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.263s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:18 devstack sudo[83648]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83cf43aa-6bf0-4c06-a621-9982174b7e28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f2d29e-2411-4040-a5c2-e4579143944e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a5f64c-d7f6-4400-9cb2-369f27598fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663" returned: 0 in 0.626s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:18 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Volume volume-39f2d29e-2411-4040-a5c2-e4579143944e (39f2d29e-2411-4040-a5c2-e4579143944e): created successfully Apr 13 10:59:18 devstack sudo[83663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663 Apr 13 10:59:18 devstack sudo[83663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a5f64c-d7f6-4400-9cb2-369f27598fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Flow 'volume_create_manager' (e26ef1e8-a5f1-44b3-a384-2fe6d0ad8dce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-d5a50616-c6c3-46cd-b6ff-14ca247af24b tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Created volume successfully. Apr 13 10:59:18 devstack sudo[83663]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c.cccc3874-147c-42ac-b42c-6ba1b978a663" returned: 0 in 0.484s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-quobyte-cccc3874-147c-42ac-b42c-6ba1b978a663" released by "_delete_snapshot" :: held 2.545s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-quobyte-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" released by "delete_snapshot" :: held 2.564s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:18 devstack cinder-volume[82656]: WARNING cinder.quota [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.quota [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Created reservations ['61d25c55-4aed-434a-b86e-b7cc35cd4a28', '5f42e2cc-50f3-4e46-a722-e857230c52eb', 'e69f434a-e072-4ca3-a9e8-4ccd5742270b', '3e814239-4db9-458f-8a92-b05afea46ee7'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 10:59:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Delete snapshot completed successfully. Apr 13 10:59:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-5dbb046a-37a8-4506-9052-f12bda547864 req-84a00b24-61f4-45d4-85c4-9c99fd23a90f tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-cccc3874-147c-42ac-b42c-6ba1b978a663-delete_snapshot" released by "delete_snapshot" :: held 2.709s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "cinder-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "cinder-quobyte-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-quobyte-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:19 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e5ea86-6733-4bad-837b-73697b591343]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:19 devstack sudo[83671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c Apr 13 10:59:19 devstack sudo[83671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:20 devstack sudo[83671]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" returned: 0 in 0.791s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:20 devstack sudo[83706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c Apr 13 10:59:20 devstack sudo[83706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:20 devstack sudo[83706]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" returned: 0 in 0.588s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-quobyte-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c" released by "delete_volume" :: held 1.445s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG cinder.quota [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Created reservations ['b0112cc4-78a1-4d35-8ad8-72f1fa61842f', '760ebee0-7062-4d18-b450-038347a51050', '173761d3-be8a-40f5-8a1b-73e3f0c6a304', 'f248fdb2-4ff2-4109-8aa0-c99c156c87e5'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:21 devstack sudo[83717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:59:21 devstack sudo[83717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:21 devstack sudo[83717]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.515s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG cinder.manager [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:59:21 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Deleted volume successfully. Apr 13 10:59:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-283e613c-c41e-4946-8253-de2bd56a224b req-9324284b-5c6e-4d08-b6f5-97cd528baf75 tempest-VolumesSnapshotsTestJSON-34030532 None] Lock "cinder-c7afc7ce-6f37-4ac1-9d47-2de1e5c49e5c-delete_volume" released by "delete_volume" :: held 2.171s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:22 devstack cinder-volume[82656]: WARNING py.warnings [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-5836f95e-5e24-4ece-abe6-70071e63a186 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] /opt/stack/cinder/cinder/db/sqlalchemy/api.py:2470: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Apr 13 10:59:22 devstack cinder-volume[82656]: .first() Apr 13 10:59:22 devstack cinder-volume[82656]: Apr 13 10:59:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-5836f95e-5e24-4ece-abe6-70071e63a186 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-5836f95e-5e24-4ece-abe6-70071e63a186 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff899bbb-d1af-4fb7-8b94-1077ccab3b3b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-5836f95e-5e24-4ece-abe6-70071e63a186 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:22 devstack sudo[83734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e Apr 13 10:59:22 devstack sudo[83734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:23 devstack sudo[83734]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-5836f95e-5e24-4ece-abe6-70071e63a186 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e" returned: 0 in 0.728s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-5836f95e-5e24-4ece-abe6-70071e63a186 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.748s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-5836f95e-5e24-4ece-abe6-70071e63a186 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e', 'name': 'volume-39f2d29e-2411-4040-a5c2-e4579143944e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dcdf0391-b95b-4421-8de9-0f03d48a6260', 'enforce_multipath': True} {{(pid=82656) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 10:59:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-eb627cdb-f0e8-4087-8eba-87f71460b6c2 req-5836f95e-5e24-4ece-abe6-70071e63a186 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] attachment_update completed successfully. Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Flow 'volume_create_manager' (ca4f8346-22a8-46b2-bd69-ba8a7b32dbdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa993a7c-9cf0-4bfd-815b-18b53ba0292d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa993a7c-9cf0-4bfd-815b-18b53ba0292d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-434433244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fecaf9a2-baa0-4242-bedb-28481cd9ba95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a90f1bae43594f00b22da4d13ce6f5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:26Z,use_quota=True,user_id='d16035b7e5b94ce88fde7c5fc515a055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4596e9-8c39-42b7-8a12-f46b79b1b264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b4596e9-8c39-42b7-8a12-f46b79b1b264) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c073c34e-24f4-4c99-b4e0-bd8fddc582bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c073c34e-24f4-4c99-b4e0-bd8fddc582bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fecaf9a2-baa0-4242-bedb-28481cd9ba95', 'volume_name': 'volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9287781c-8c71-4637-ba8a-5fd627dd768a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9287781c-8c71-4637-ba8a-5fd627dd768a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dcce09-c9c9-469b-bb28-6f14fe11d740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:26 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Volume fecaf9a2-baa0-4242-bedb-28481cd9ba95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95', 'volume_size': 1} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-434433244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fecaf9a2-baa0-4242-bedb-28481cd9ba95,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a90f1bae43594f00b22da4d13ce6f5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:26Z,use_quota=True,user_id='d16035b7e5b94ce88fde7c5fc515a055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Creating volume fecaf9a2-baa0-4242-bedb-28481cd9ba95 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 10:59:26 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 10:59:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:26 devstack sudo[83826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 1073741824 Apr 13 10:59:26 devstack sudo[83826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:27 devstack sudo[83826]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 1073741824" returned: 0 in 0.680s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:27 devstack sudo[83841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 Apr 13 10:59:27 devstack sudo[83841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:27 devstack sudo[83841]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95" returned: 0 in 0.505s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85dcce09-c9c9-469b-bb28-6f14fe11d740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0e100a-314a-4d4e-aa2a-e04f224c5548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:27 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Volume volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 (fecaf9a2-baa0-4242-bedb-28481cd9ba95): created successfully Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0e100a-314a-4d4e-aa2a-e04f224c5548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Flow 'volume_create_manager' (ca4f8346-22a8-46b2-bd69-ba8a7b32dbdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:27 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ed0426c7-7f8e-4e6a-a70d-eaae31a393f8 tempest-VolumesTestJSON-2053147211 None] Created volume successfully. Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Flow 'volume_create_manager' (34f4fe2c-b21f-4a96-b79c-ac877c0fd967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f10784b-784e-4fe7-8480-7301673d6efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f10784b-784e-4fe7-8480-7301673d6efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-3481798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcc2baf-a05a-4af3-8688-f98063d8bb0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a90f1bae43594f00b22da4d13ce6f5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:30Z,use_quota=True,user_id='d16035b7e5b94ce88fde7c5fc515a055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdd5b63-1cf7-4520-b3c4-7b3d2988dd2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cdd5b63-1cf7-4520-b3c4-7b3d2988dd2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5051b5-b3bf-4485-bc35-d0e4055a05cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5051b5-b3bf-4485-bc35-d0e4055a05cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edcc2baf-a05a-4af3-8688-f98063d8bb0f', 'volume_name': 'volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ca3d3c-64e7-426c-8945-8e6fcbc36fe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1ca3d3c-64e7-426c-8945-8e6fcbc36fe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6341786d-b79b-4b29-b582-ab8ccc93d113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:29 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Volume edcc2baf-a05a-4af3-8688-f98063d8bb0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f', 'volume_size': 1} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-3481798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edcc2baf-a05a-4af3-8688-f98063d8bb0f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a90f1bae43594f00b22da4d13ce6f5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:30Z,use_quota=True,user_id='d16035b7e5b94ce88fde7c5fc515a055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Creating volume edcc2baf-a05a-4af3-8688-f98063d8bb0f {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 10:59:29 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 10:59:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:30 devstack sudo[84214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f 1073741824 Apr 13 10:59:30 devstack sudo[84214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:30 devstack sudo[84214]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f 1073741824" returned: 0 in 0.608s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:30 devstack sudo[84221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f Apr 13 10:59:30 devstack sudo[84221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:31 devstack sudo[84221]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f" returned: 0 in 0.480s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 10:59:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6341786d-b79b-4b29-b582-ab8ccc93d113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b47efeb-e809-4c5e-907f-246283a4a21e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Volume volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f (edcc2baf-a05a-4af3-8688-f98063d8bb0f): created successfully Apr 13 10:59:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b47efeb-e809-4c5e-907f-246283a4a21e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Flow 'volume_create_manager' (34f4fe2c-b21f-4a96-b79c-ac877c0fd967) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:31 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9b768103-b050-4802-8384-532094a28009 tempest-VolumesTestJSON-2053147211 None] Created volume successfully. Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Flow 'volume_create_manager' (2267e6f8-428c-4f9e-a9d9-ab32868673be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efdb29e-fc0e-4f7e-a17f-82898ea513ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3efdb29e-fc0e-4f7e-a17f-82898ea513ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-756423211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145740da-84b9-44c9-ab84-389fc2c9987a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a90f1bae43594f00b22da4d13ce6f5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:32Z,use_quota=True,user_id='d16035b7e5b94ce88fde7c5fc515a055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90eb01c2-431f-4528-a537-5340e2569b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90eb01c2-431f-4528-a537-5340e2569b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72506c8f-aaad-40b3-8711-b20e5b3e12ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72506c8f-aaad-40b3-8711-b20e5b3e12ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '145740da-84b9-44c9-ab84-389fc2c9987a', 'volume_name': 'volume-145740da-84b9-44c9-ab84-389fc2c9987a', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e708fcd0-e4f4-4b60-ad4d-021adb53fe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e708fcd0-e4f4-4b60-ad4d-021adb53fe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cacd435-ff0d-4192-835c-8a121d20ea47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:32 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Volume 145740da-84b9-44c9-ab84-389fc2c9987a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-145740da-84b9-44c9-ab84-389fc2c9987a', 'volume_size': 1} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-756423211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=145740da-84b9-44c9-ab84-389fc2c9987a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a90f1bae43594f00b22da4d13ce6f5e8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:32Z,use_quota=True,user_id='d16035b7e5b94ce88fde7c5fc515a055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Creating volume 145740da-84b9-44c9-ab84-389fc2c9987a {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 10:59:32 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 10:59:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:32 devstack sudo[84228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a 1073741824 Apr 13 10:59:32 devstack sudo[84228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:33 devstack sudo[84228]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a 1073741824" returned: 0 in 0.636s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:33 devstack sudo[84233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a Apr 13 10:59:33 devstack sudo[84233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Flow 'volume_create_manager' (58942cbc-0f2b-44c0-8c15-9e9b6ff365cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77533936-1bd2-4ea5-87ce-c7b25358912c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77533936-1bd2-4ea5-87ce-c7b25358912c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1504205541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a6e8e9-77af-4155-a239-dd0637ce52a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c88b3526b3426e917a969afc8b072a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:34Z,use_quota=True,user_id='6734441b0df14a56a455863b048a284c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f388c6-8e40-4861-96e1-bbf10c417727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34f388c6-8e40-4861-96e1-bbf10c417727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36d4fb9-ea86-4c22-9b6d-0193c87c2af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36d4fb9-ea86-4c22-9b6d-0193c87c2af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60a6e8e9-77af-4155-a239-dd0637ce52a6', 'volume_name': 'volume-60a6e8e9-77af-4155-a239-dd0637ce52a6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b79744-2212-4217-a953-b94e1b48c382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46b79744-2212-4217-a953-b94e1b48c382) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46e9d7d-5a70-49df-801d-e6c25ddaf680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:33 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Volume 60a6e8e9-77af-4155-a239-dd0637ce52a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60a6e8e9-77af-4155-a239-dd0637ce52a6', 'volume_size': 1} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:33 devstack sudo[84233]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a" returned: 0 in 0.729s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] <== create_volume: return (1441ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.041s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T08:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1504205541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60a6e8e9-77af-4155-a239-dd0637ce52a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='65c88b3526b3426e917a969afc8b072a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T08:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T08:59:34Z,use_quota=True,user_id='6734441b0df14a56a455863b048a284c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Creating volume 60a6e8e9-77af-4155-a239-dd0637ce52a6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 10:59:33 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:33 devstack sudo[84236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 1073741824 Apr 13 10:59:33 devstack sudo[84236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5cacd435-ff0d-4192-835c-8a121d20ea47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-145740da-84b9-44c9-ab84-389fc2c9987a', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da3e1f4-4521-4ba4-ac55-0c5dc48a65f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:33 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Volume volume-145740da-84b9-44c9-ab84-389fc2c9987a (145740da-84b9-44c9-ab84-389fc2c9987a): created successfully Apr 13 10:59:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1da3e1f4-4521-4ba4-ac55-0c5dc48a65f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Flow 'volume_create_manager' (2267e6f8-428c-4f9e-a9d9-ab32868673be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:34 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f925059a-f67e-49c0-a5b8-d86abec1d7f1 tempest-VolumesTestJSON-2053147211 None] Created volume successfully. Apr 13 10:59:34 devstack sudo[84236]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 1073741824" returned: 0 in 0.601s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:34 devstack sudo[84241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 Apr 13 10:59:34 devstack sudo[84241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:35 devstack sudo[84241]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6" returned: 0 in 0.683s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] <== create_volume: return (1337ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.340s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46e9d7d-5a70-49df-801d-e6c25ddaf680) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60a6e8e9-77af-4155-a239-dd0637ce52a6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9e1a1f-5b4a-4567-a305-5678b480d69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 10:59:35 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Volume volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 (60a6e8e9-77af-4155-a239-dd0637ce52a6): created successfully Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a9e1a1f-5b4a-4567-a305-5678b480d69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Flow 'volume_create_manager' (58942cbc-0f2b-44c0-8c15-9e9b6ff365cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 10:59:35 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d73790c0-9b54-43d1-acb8-6a7f24582af6 tempest-DeleteServersTestJSON-1612847534 None] Created volume successfully. Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "cinder-145740da-84b9-44c9-ab84-389fc2c9987a-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Lock "cinder-145740da-84b9-44c9-ab84-389fc2c9987a-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "cinder-quobyte-145740da-84b9-44c9-ab84-389fc2c9987a" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Lock "cinder-quobyte-145740da-84b9-44c9-ab84-389fc2c9987a" acquired by "delete_volume" :: waited 0.023s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c0ce21-d60e-4b88-bccb-ba0345b47416]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:36 devstack sudo[84272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a Apr 13 10:59:36 devstack sudo[84272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:37 devstack sudo[84272]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a" returned: 0 in 1.109s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:37 devstack sudo[84320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a Apr 13 10:59:37 devstack sudo[84320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:37 devstack sudo[84320]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-145740da-84b9-44c9-ab84-389fc2c9987a" returned: 0 in 0.911s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Lock "cinder-quobyte-145740da-84b9-44c9-ab84-389fc2c9987a" released by "delete_volume" :: held 2.080s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Created reservations ['31515a14-54e5-4904-b968-f2b1dd150153', 'cb15f62c-6946-426e-b753-32079ebde995', '1461f7c3-c590-4441-8710-7db75ad9bc1d', '25ffb46d-e78c-4b8c-aff6-bd74f6fac6c3'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Acquiring lock "cinder-edcc2baf-a05a-4af3-8688-f98063d8bb0f-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Lock "cinder-edcc2baf-a05a-4af3-8688-f98063d8bb0f-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:38 devstack sudo[84330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:59:38 devstack sudo[84330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Acquiring lock "cinder-quobyte-edcc2baf-a05a-4af3-8688-f98063d8bb0f" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Lock "cinder-quobyte-edcc2baf-a05a-4af3-8688-f98063d8bb0f" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89b2119-cd60-446a-9ca4-eb94c01d7269]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:38 devstack sudo[84335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f Apr 13 10:59:38 devstack sudo[84335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:38 devstack sudo[84330]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.542s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:59:38 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Deleted volume successfully. Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4489c7e3-ecfd-4eab-a57c-72f19a9ecb71 tempest-VolumesTestJSON-2053147211 None] Lock "cinder-145740da-84b9-44c9-ab84-389fc2c9987a-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:38 devstack sudo[84344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:59:38 devstack sudo[84344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:39 devstack sudo[84335]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f" returned: 0 in 0.914s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:39 devstack sudo[84350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f Apr 13 10:59:39 devstack sudo[84350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:39 devstack sudo[84344]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.942s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-657baa45-c9c1-47d5-91a5-05f6c34f9a72 req-c0dcbc3b-621c-4c3e-87bc-0e42c293ac67 tempest-DeleteServersTestJSON-1612847534 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-657baa45-c9c1-47d5-91a5-05f6c34f9a72 req-c0dcbc3b-621c-4c3e-87bc-0e42c293ac67 tempest-DeleteServersTestJSON-1612847534 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec729ed8-1a18-4519-96ae-32caeef2911c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-657baa45-c9c1-47d5-91a5-05f6c34f9a72 req-c0dcbc3b-621c-4c3e-87bc-0e42c293ac67 tempest-DeleteServersTestJSON-1612847534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:39 devstack sudo[84350]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-edcc2baf-a05a-4af3-8688-f98063d8bb0f" returned: 0 in 0.749s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Lock "cinder-quobyte-edcc2baf-a05a-4af3-8688-f98063d8bb0f" released by "delete_volume" :: held 1.730s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:39 devstack sudo[84363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 Apr 13 10:59:39 devstack sudo[84363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Created reservations ['af765f69-bf3d-49ca-bf50-2840c00c9583', '3cdb1063-37f2-4003-ad3d-57cff2cd40f4', 'a9843fca-aceb-43fa-8dc9-cb330e8fde5a', '4478bea8-4779-43be-afb4-84d3b3a85e98'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:40 devstack sudo[84365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:59:40 devstack sudo[84365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "cinder-fecaf9a2-baa0-4242-bedb-28481cd9ba95-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Lock "cinder-fecaf9a2-baa0-4242-bedb-28481cd9ba95-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "cinder-quobyte-fecaf9a2-baa0-4242-bedb-28481cd9ba95" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Lock "cinder-quobyte-fecaf9a2-baa0-4242-bedb-28481cd9ba95" acquired by "delete_volume" :: waited 0.024s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38e008a-ba65-4cfa-a6e8-a2d5c6ce9679]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:40 devstack sudo[84367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 Apr 13 10:59:40 devstack sudo[84367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:40 devstack sudo[84363]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-657baa45-c9c1-47d5-91a5-05f6c34f9a72 req-c0dcbc3b-621c-4c3e-87bc-0e42c293ac67 tempest-DeleteServersTestJSON-1612847534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6" returned: 0 in 1.017s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-657baa45-c9c1-47d5-91a5-05f6c34f9a72 req-c0dcbc3b-621c-4c3e-87bc-0e42c293ac67 tempest-DeleteServersTestJSON-1612847534 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.030s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-657baa45-c9c1-47d5-91a5-05f6c34f9a72 req-c0dcbc3b-621c-4c3e-87bc-0e42c293ac67 tempest-DeleteServersTestJSON-1612847534 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e', 'name': 'volume-60a6e8e9-77af-4155-a239-dd0637ce52a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f9f10409-a605-4a87-8dc3-48ca69877115', 'enforce_multipath': True} {{(pid=82656) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 10:59:40 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-657baa45-c9c1-47d5-91a5-05f6c34f9a72 req-c0dcbc3b-621c-4c3e-87bc-0e42c293ac67 tempest-DeleteServersTestJSON-1612847534 None] attachment_update completed successfully. Apr 13 10:59:41 devstack sudo[84365]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.934s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:41 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:59:41 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Deleted volume successfully. Apr 13 10:59:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-83666f92-f8f9-4453-a08c-e6f2246deded tempest-VolumesTestJSON-2053147211 None] Lock "cinder-edcc2baf-a05a-4af3-8688-f98063d8bb0f-delete_volume" released by "delete_volume" :: held 2.859s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:41 devstack sudo[84367]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95" returned: 0 in 1.068s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:41 devstack sudo[84380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95 Apr 13 10:59:41 devstack sudo[84380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:42 devstack sudo[84380]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fecaf9a2-baa0-4242-bedb-28481cd9ba95" returned: 0 in 0.535s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Lock "cinder-quobyte-fecaf9a2-baa0-4242-bedb-28481cd9ba95" released by "delete_volume" :: held 1.624s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Created reservations ['9e517f57-1a59-42e0-a0d8-ea1931cad801', 'e6e5791d-15c1-4b4f-92c0-a562b204bf35', '494f03f1-9ade-4481-914e-64b910d66958', 'd4d2a6aa-f8ca-46eb-90c7-d681823d6c52'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:42 devstack sudo[84386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:59:42 devstack sudo[84386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:43 devstack sudo[84386]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.245s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:43 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:59:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Deleted volume successfully. Apr 13 10:59:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc8ddb0a-d88a-4e62-9a92-1553363f57d6 tempest-VolumesTestJSON-2053147211 None] Lock "cinder-fecaf9a2-baa0-4242-bedb-28481cd9ba95-delete_volume" released by "delete_volume" :: held 3.113s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:49 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-65939948-7f1b-40fb-8319-c22dd204f152 req-e983cca5-48be-4845-8434-32e5b8dca91e tempest-DeleteServersTestJSON-1612847534 None] Terminate volume connection completed successfully. Apr 13 10:59:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-65939948-7f1b-40fb-8319-c22dd204f152 req-e983cca5-48be-4845-8434-32e5b8dca91e tempest-DeleteServersTestJSON-1612847534 None] Deleting attachment f9f10409-a605-4a87-8dc3-48ca69877115. {{(pid=82656) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Acquiring lock "cinder-60a6e8e9-77af-4155-a239-dd0637ce52a6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Lock "cinder-60a6e8e9-77af-4155-a239-dd0637ce52a6-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=73,cinder:SELECT=61,cinder:INSERT=21,cinder:DELETE=6 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Acquiring lock "cinder-quobyte-60a6e8e9-77af-4155-a239-dd0637ce52a6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Lock "cinder-quobyte-60a6e8e9-77af-4155-a239-dd0637ce52a6" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[321a099a-62ce-47db-8632-844c93ce7d70]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:53 devstack sudo[84551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 Apr 13 10:59:53 devstack sudo[84551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:53 devstack sudo[84551]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6" returned: 0 in 0.556s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:53 devstack sudo[84556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6 Apr 13 10:59:53 devstack sudo[84556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:54 devstack sudo[84556]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-60a6e8e9-77af-4155-a239-dd0637ce52a6" returned: 0 in 0.561s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Lock "cinder-quobyte-60a6e8e9-77af-4155-a239-dd0637ce52a6" released by "delete_volume" :: held 1.150s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Created reservations ['df3584a0-06b1-43b8-85ae-f389c84d9293', '898346a1-3339-4d0b-8938-12925add8ea2', '3c443b05-4811-46c9-a92e-40f9f8b9b1e6', '5f07e0df-f8b0-40ee-9d81-de85b2be29e8'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 10:59:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 10:59:54 devstack sudo[84559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 10:59:54 devstack sudo[84559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 10:59:55 devstack sudo[84559]: pam_unix(sudo:session): session closed for user root Apr 13 10:59:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.525s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 10:59:55 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 10:59:55 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Deleted volume successfully. Apr 13 10:59:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f96f8560-c569-40e3-95e9-687e40b942f2 tempest-DeleteServersTestJSON-1612847534 None] Lock "cinder-60a6e8e9-77af-4155-a239-dd0637ce52a6-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:01 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=67,cinder:UPDATE=81,cinder:DELETE=7,cinder:INSERT=15 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Flow 'volume_create_manager' (a6d93b0b-531c-4b1a-95cc-a05565143001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a0eb54-2a45-4bfb-a82b-2c838b6ccb88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54a0eb54-2a45-4bfb-a82b-2c838b6ccb88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1294154376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c97376c-8f5f-4a1b-bf85-d260dcfedb0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f58b55e39f941518f0ab2562a7ba196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:03Z,use_quota=True,user_id='ae23b0dbe5414b06b3aadf1c859e387f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b045624d-a267-4af9-b7bd-e8a8a31137dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b045624d-a267-4af9-b7bd-e8a8a31137dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab5043e-74e3-4d88-b184-2579e3cbc463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ab5043e-74e3-4d88-b184-2579e3cbc463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c97376c-8f5f-4a1b-bf85-d260dcfedb0e', 'volume_name': 'volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec2b42d-9433-4185-ab38-108dea21af1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec2b42d-9433-4185-ab38-108dea21af1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5059704e-74e2-49b9-8cbe-a1259606d17a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:02 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Volume 0c97376c-8f5f-4a1b-bf85-d260dcfedb0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e', 'volume_size': 1} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1294154376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c97376c-8f5f-4a1b-bf85-d260dcfedb0e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='3f58b55e39f941518f0ab2562a7ba196',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:03Z,use_quota=True,user_id='ae23b0dbe5414b06b3aadf1c859e387f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Creating volume 0c97376c-8f5f-4a1b-bf85-d260dcfedb0e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:02 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:02 devstack sudo[84654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e 1073741824 Apr 13 11:00:02 devstack sudo[84654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:04 devstack sudo[84654]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e 1073741824" returned: 0 in 1.386s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:04 devstack sudo[84662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e Apr 13 11:00:04 devstack sudo[84662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:04 devstack sudo[84662]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e" returned: 0 in 0.646s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.101s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5059704e-74e2-49b9-8cbe-a1259606d17a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde85828-57e9-4dd9-95a3-f07e77102561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:04 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Volume volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e (0c97376c-8f5f-4a1b-bf85-d260dcfedb0e): created successfully Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bde85828-57e9-4dd9-95a3-f07e77102561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Flow 'volume_create_manager' (a6d93b0b-531c-4b1a-95cc-a05565143001) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:04 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-1c7313a0-0a82-485d-b9c7-1213e657d5d3 req-2487d1a0-99f8-47d5-9d59-939a6b88cfc5 tempest-VolumesGetTestJSON-1923426419 None] Created volume successfully. Apr 13 11:00:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Acquiring lock "cinder-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Lock "cinder-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Acquiring lock "cinder-quobyte-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Lock "cinder-quobyte-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:05 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d70fbf-f8ca-495a-aacd-f7f0b2b847af]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:05 devstack sudo[84667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e Apr 13 11:00:05 devstack sudo[84667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:06 devstack sudo[84667]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e" returned: 0 in 1.254s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:06 devstack sudo[84682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e Apr 13 11:00:06 devstack sudo[84682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:08 devstack sudo[84682]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e" returned: 0 in 1.551s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Lock "cinder-quobyte-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e" released by "delete_volume" :: held 2.859s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG cinder.quota [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Created reservations ['861166c1-494c-470a-b53d-22d5b4132598', 'fdfb6deb-25ae-4b38-bd27-80eab816efc2', '22b8f5ec-d54d-472f-ac48-a7e45ab8c946', '64cd5558-a4f2-4e8a-9540-c47b98fdb394'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:08 devstack sudo[84706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:08 devstack sudo[84706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:09 devstack sudo[84706]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.736s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:09 devstack cinder-volume[82656]: DEBUG cinder.manager [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:09 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Deleted volume successfully. Apr 13 11:00:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-7dcf4acd-4cfc-441f-b7f8-b4f8625ac6a1 req-bcffe110-9f82-4205-b10e-ee763ad12a46 tempest-VolumesGetTestJSON-1923426419 None] Lock "cinder-0c97376c-8f5f-4a1b-bf85-d260dcfedb0e-delete_volume" released by "delete_volume" :: held 3.915s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:13 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1ac57e81-09e0-4ac8-adca-3f20221b2080 tempest-GroupsV314Test-1715432989 None] Group tempest-GroupsV314Test-Group-1978955834: creating Apr 13 11:00:13 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1ac57e81-09e0-4ac8-adca-3f20221b2080 tempest-GroupsV314Test-1715432989 None] Group tempest-GroupsV314Test-Group-1978955834: created successfully Apr 13 11:00:13 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1ac57e81-09e0-4ac8-adca-3f20221b2080 tempest-GroupsV314Test-1715432989 None] Create group completed successfully. Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Flow 'volume_create_manager' (13c88fd5-f6f6-47c3-80e8-10bb0e826f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bb2805-68ab-46f1-89a4-d15679ca78c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89bb2805-68ab-46f1-89a4-d15679ca78c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-455863797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0621b85-9e28-4c3c-b43b-bc4f5f1bc947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd13b71d785845db855fec715edef589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:14Z,use_quota=True,user_id='74238b7b8e9746b1a3f0b844ef276cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f7d3c2-ca9e-4827-b594-6d4f95a44501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f7d3c2-ca9e-4827-b594-6d4f95a44501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae85ad5c-771c-45cf-968c-ef4b33df813b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae85ad5c-771c-45cf-968c-ef4b33df813b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0621b85-9e28-4c3c-b43b-bc4f5f1bc947', 'volume_name': 'volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cda4e7-1d3a-402d-a9a7-54180affff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99cda4e7-1d3a-402d-a9a7-54180affff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefdff74-7206-4c87-b74f-dfd25b9f8133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:14 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Volume d0621b85-9e28-4c3c-b43b-bc4f5f1bc947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947', 'volume_size': 1} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-455863797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0621b85-9e28-4c3c-b43b-bc4f5f1bc947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd13b71d785845db855fec715edef589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:14Z,use_quota=True,user_id='74238b7b8e9746b1a3f0b844ef276cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Creating volume d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:14 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:14 devstack sudo[84775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 1073741824 Apr 13 11:00:14 devstack sudo[84775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Flow 'volume_create_manager' (495e6445-e65a-4489-85b9-1ffe7c5288a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d548dde0-bfd0-4661-a34b-920fc60e7502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d548dde0-bfd0-4661-a34b-920fc60e7502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-249106651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57404a69-b910-4902-a7bb-ee093fb2a470,host='devstack@QuobyteHD#QuobyteHD',id=504ba8a0-d855-4012-a306-0b4debf34ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4469df4c7c7b48ac83c8509f499e24bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:15Z,use_quota=True,user_id='94549121b00d4acdb2f513cc22b9c676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d1ef447-9d7a-4522-b2dd-60096c246316),volume_type_id=0d1ef447-9d7a-4522-b2dd-60096c246316)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8e9483-9de1-4ded-9eb4-af2daa4aab8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8e9483-9de1-4ded-9eb4-af2daa4aab8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6983aa3-d996-4b30-a67f-a1c1e77337cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6983aa3-d996-4b30-a67f-a1c1e77337cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '504ba8a0-d855-4012-a306-0b4debf34ba0', 'volume_name': 'volume-504ba8a0-d855-4012-a306-0b4debf34ba0', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deade7ac-126a-4bcb-9e87-59042f0c6435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deade7ac-126a-4bcb-9e87-59042f0c6435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33af891b-0b13-4fd6-ad4b-354d160b6aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:15 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Volume 504ba8a0-d855-4012-a306-0b4debf34ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-504ba8a0-d855-4012-a306-0b4debf34ba0', 'volume_size': 1} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:15 devstack sudo[84775]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 1073741824" returned: 0 in 1.652s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:15 devstack sudo[84785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 Apr 13 11:00:15 devstack sudo[84785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:16 devstack sudo[84785]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] <== create_volume: return (2157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.162s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=57404a69-b910-4902-a7bb-ee093fb2a470,created_at=2026-04-13T09:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-249106651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=57404a69-b910-4902-a7bb-ee093fb2a470,host='devstack@QuobyteHD#QuobyteHD',id=504ba8a0-d855-4012-a306-0b4debf34ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4469df4c7c7b48ac83c8509f499e24bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:15Z,use_quota=True,user_id='94549121b00d4acdb2f513cc22b9c676',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d1ef447-9d7a-4522-b2dd-60096c246316),volume_type_id=0d1ef447-9d7a-4522-b2dd-60096c246316)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Creating volume 504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:16 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cefdff74-7206-4c87-b74f-dfd25b9f8133) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:16 devstack sudo[84788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 1073741824 Apr 13 11:00:16 devstack sudo[84788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1333ab1-332d-4cdf-aeba-f862869407f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:16 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Volume volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 (d0621b85-9e28-4c3c-b43b-bc4f5f1bc947): created successfully Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1333ab1-332d-4cdf-aeba-f862869407f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Flow 'volume_create_manager' (13c88fd5-f6f6-47c3-80e8-10bb0e826f04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-cf445b3b-bc51-40c1-9de8-cc4824b8f159 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Created volume successfully. Apr 13 11:00:17 devstack sudo[84788]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 1073741824" returned: 0 in 1.023s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Acquiring lock "cinder-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:17 devstack sudo[84795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 Apr 13 11:00:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "cinder-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:17 devstack sudo[84795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Acquiring lock "cinder-quobyte-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "cinder-quobyte-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947" acquired by "delete_volume" :: waited 0.022s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0f02ff-cd53-420b-a929-b129cef2b617]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:17 devstack sudo[84797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 Apr 13 11:00:17 devstack sudo[84797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:18 devstack sudo[84797]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947" returned: 0 in 0.780s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:18 devstack sudo[84831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947 Apr 13 11:00:18 devstack sudo[84831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:18 devstack sudo[84795]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0" returned: 0 in 1.141s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] <== create_volume: return (2196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.200s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33af891b-0b13-4fd6-ad4b-354d160b6aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-504ba8a0-d855-4012-a306-0b4debf34ba0', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ce0c99-cc97-48dc-8323-b21c4587057a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:18 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Volume volume-504ba8a0-d855-4012-a306-0b4debf34ba0 (504ba8a0-d855-4012-a306-0b4debf34ba0): created successfully Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80ce0c99-cc97-48dc-8323-b21c4587057a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Flow 'volume_create_manager' (495e6445-e65a-4489-85b9-1ffe7c5288a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f17f94f3-e142-4fec-9a28-6bdf6f589907 tempest-GroupsV314Test-1715432989 None] Created volume successfully. Apr 13 11:00:19 devstack sudo[84831]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947" returned: 0 in 0.809s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "cinder-quobyte-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947" released by "delete_volume" :: held 1.632s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Created reservations ['2fb7779c-02a7-4d3a-bdf5-1e7fb685e181', '2781c0d9-92fe-484f-9095-b9cb37e52f50', '9803c278-0fc6-4d9c-864d-5d38fdab0e7f', '8e7f2dbb-a403-42f5-b981-9f425812623f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:19 devstack sudo[84841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:19 devstack sudo[84841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Flow 'volume_create_manager' (0e167c85-c98b-4a15-9425-bfe6b20fc3cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9eafc3-c653-4b01-97b2-61581bbd75b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:20 devstack sudo[84841]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc9eafc3-c653-4b01-97b2-61581bbd75b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2067027102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d740aa33-d746-444e-847e-acc2ae651ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd13b71d785845db855fec715edef589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:20Z,use_quota=True,user_id='74238b7b8e9746b1a3f0b844ef276cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42886eaa-9ef8-4ad2-a93d-af15f15c3301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42886eaa-9ef8-4ad2-a93d-af15f15c3301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1475ce1d-4f0b-41c9-bbb7-a52643d1e036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1475ce1d-4f0b-41c9-bbb7-a52643d1e036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd740aa33-d746-444e-847e-acc2ae651ade', 'volume_name': 'volume-d740aa33-d746-444e-847e-acc2ae651ade', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd49377-ef81-4a01-a339-42d8f9713293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cd49377-ef81-4a01-a339-42d8f9713293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2465b8-6fcb-4c89-9edf-161653eb858f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:20 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Volume d740aa33-d746-444e-847e-acc2ae651ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d740aa33-d746-444e-847e-acc2ae651ade', 'volume_size': 1} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2067027102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d740aa33-d746-444e-847e-acc2ae651ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd13b71d785845db855fec715edef589',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:20Z,use_quota=True,user_id='74238b7b8e9746b1a3f0b844ef276cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Creating volume d740aa33-d746-444e-847e-acc2ae651ade {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:20 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:20 devstack sudo[84845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade 1073741824 Apr 13 11:00:20 devstack sudo[84845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.949s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:20 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Deleted volume successfully. Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4bd4f946-b8a9-487a-9541-07046867a527 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "cinder-d0621b85-9e28-4c3c-b43b-bc4f5f1bc947-delete_volume" released by "delete_volume" :: held 2.875s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:20 devstack sudo[84845]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade 1073741824" returned: 0 in 0.559s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:20 devstack sudo[84850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade Apr 13 11:00:20 devstack sudo[84850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:21 devstack sudo[84850]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade" returned: 0 in 0.559s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.152s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.977s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:21 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Cloning volume 504ba8a0-d855-4012-a306-0b4debf34ba0 to volume c79b9b52-9c19-465d-b6f3-ee623942da83 Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e2465b8-6fcb-4c89-9edf-161653eb858f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d740aa33-d746-444e-847e-acc2ae651ade', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0d773a-18bf-4abf-b79d-bd9fa8406e92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:21 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Volume volume-d740aa33-d746-444e-847e-acc2ae651ade (d740aa33-d746-444e-847e-acc2ae651ade): created successfully Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb0d773a-18bf-4abf-b79d-bd9fa8406e92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Flow 'volume_create_manager' (0e167c85-c98b-4a15-9425-bfe6b20fc3cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:21 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2603c81d-da94-4fd2-80fa-cf37e32af601 tempest-VolumeQuotasAdminTestJSON-1797524204 None] Created volume successfully. Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Creating offline snapshot 9d0452b2-8a80-4845-842e-25a7227cd18e of volume 504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7ab3c0-78db-44e7-a608-4e9a8095552d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:21 devstack sudo[84860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 Apr 13 11:00:21 devstack sudo[84860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:22 devstack sudo[84860]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0" returned: 0 in 0.536s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:22 devstack sudo[84883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e 1G Apr 13 11:00:22 devstack sudo[84883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:22 devstack sudo[84883]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e 1G" returned: 0 in 0.626s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504ba8a0-d855-4012-a306-0b4debf34ba0 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:22 devstack sudo[84888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504ba8a0-d855-4012-a306-0b4debf34ba0 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e Apr 13 11:00:22 devstack sudo[84888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-fa1f43ea-b4e2-45be-9fa4-6cc88e2cc7e5 tempest-VolumeQuotasAdminTestJSON-81771094 None] Transfer volume completed successfully. Apr 13 11:00:23 devstack sudo[84888]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-504ba8a0-d855-4012-a306-0b4debf34ba0 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e" returned: 0 in 0.797s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:23 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:00:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:23 devstack sudo[84905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e Apr 13 11:00:23 devstack sudo[84905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:24 devstack sudo[84905]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e" returned: 0 in 0.693s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:24 devstack sudo[84913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.info Apr 13 11:00:24 devstack sudo[84913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Acquiring lock "cinder-d740aa33-d746-444e-847e-acc2ae651ade-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Lock "cinder-d740aa33-d746-444e-847e-acc2ae651ade-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Acquiring lock "cinder-quobyte-d740aa33-d746-444e-847e-acc2ae651ade" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Lock "cinder-quobyte-d740aa33-d746-444e-847e-acc2ae651ade" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:24 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[78310e46-30f2-4820-a579-4469f8246409]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:25 devstack sudo[84915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade Apr 13 11:00:25 devstack sudo[84915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:25 devstack sudo[84913]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.info" returned: 0 in 1.199s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:25 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:00:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:25 devstack sudo[84942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.info Apr 13 11:00:25 devstack sudo[84942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:25 devstack sudo[84915]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade" returned: 0 in 1.074s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:25 devstack sudo[84949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade Apr 13 11:00:25 devstack sudo[84949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Flow 'volume_create_manager' (9c54e574-4fe0-4cd2-8355-6cbffcf8eac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecabf7cb-86bc-4dba-86f2-173d6078afb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecabf7cb-86bc-4dba-86f2-173d6078afb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-882052836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49849b2-be45-4dc2-9e09-9ea66cef593d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002cae5f98a449fc83759cc84b3196cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:26Z,use_quota=True,user_id='c5152d606b0049a087f6d0df915d35ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c256a26f-3268-401a-a03c-e6f5fbb047f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c256a26f-3268-401a-a03c-e6f5fbb047f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf777fff-dd7f-439e-880d-5c59b29762cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf777fff-dd7f-439e-880d-5c59b29762cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49849b2-be45-4dc2-9e09-9ea66cef593d', 'volume_name': 'volume-b49849b2-be45-4dc2-9e09-9ea66cef593d', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37e37f2-85d0-4fe7-a309-96770aa094e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f37e37f2-85d0-4fe7-a309-96770aa094e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dbdc19-eb35-4eed-8287-2cc6b0204b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Volume b49849b2-be45-4dc2-9e09-9ea66cef593d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49849b2-be45-4dc2-9e09-9ea66cef593d', 'volume_size': 1} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Flow 'volume_create_manager' (1f567919-763b-4cd0-aad5-ff8241a36518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dbe7ee-57e8-4d4b-90bc-16c2d4e02908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69dbe7ee-57e8-4d4b-90bc-16c2d4e02908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:26Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3c67c065974df5a71d3d42a7c5e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:26Z,use_quota=True,user_id='04d2224e74f74c74af3ec395f8347183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6072c34-51e7-4c15-bff0-c36e58258945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6072c34-51e7-4c15-bff0-c36e58258945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161d60ee-4428-4965-80c9-dc6422daefd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.image.glance [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Creating Keystone auth plugin from conf {{(pid=82656) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 11:00:26 devstack sudo[84949]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d740aa33-d746-444e-847e-acc2ae651ade" returned: 0 in 0.545s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Lock "cinder-quobyte-d740aa33-d746-444e-847e-acc2ae651ade" released by "delete_volume" :: held 1.723s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Created reservations ['7f44b3c8-a127-4f9c-a75e-255bb7c540ef', '3a87e4fa-7f1f-4fb9-b78b-c3509abb16a3', '969ffb9b-916d-4a58-ad03-a08375004762', 'b4973143-eee6-45e4-b752-648cc687591f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:26 devstack sudo[84955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:26 devstack sudo[84955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:26 devstack sudo[84942]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.info" returned: 0 in 1.423s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Acquiring lock "cinder-quobyte-c79b9b52-9c19-465d-b6f3-ee623942da83" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Lock "cinder-quobyte-c79b9b52-9c19-465d-b6f3-ee623942da83" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] snapshot: 9d0452b2-8a80-4845-842e-25a7227cd18e, volume: c79b9b52-9c19-465d-b6f3-ee623942da83, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (161d60ee-4428-4965-80c9-dc6422daefd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1', 'volume_name': 'volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d74a4c-087c-4614-afb9-4982c7d6eda4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d74a4c-087c-4614-afb9-4982c7d6eda4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a38a0fc-9d64-4eb9-8daf-790051e242a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:26 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Volume e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Trying to clone e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 from image 22e76a71-372d-4748-bc00-afb5725ee06e at location (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]). {{(pid=82656) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[269eaea2-9596-4b0c-af50-e868bf6be235]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:27 devstack sudo[84957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e Apr 13 11:00:27 devstack sudo[84957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:27 devstack sudo[84955]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.707s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:27 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Deleted volume successfully. Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b320af1b-f926-4a2b-9aa0-d38986eb6c9f tempest-VolumeQuotasAdminTestJSON-20797363 None] Lock "cinder-d740aa33-d746-444e-847e-acc2ae651ade-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 11:00:27 devstack cinder-volume[82656]: INFO cinder.image.image_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Image download 20.69 MB at 20.69 MB/s Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2205c42c-ca67-4f27-a895-82320361838b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:27 devstack sudo[84981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD Apr 13 11:00:27 devstack sudo[84981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:28 devstack sudo[84957]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e" returned: 0 in 1.130s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-504ba8a0-d855-4012-a306-0b4debf34ba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0d5034-ed2b-405b-aaa9-3e2a044192f3]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:28 devstack sudo[84986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 Apr 13 11:00:28 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:28 devstack sudo[84981]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD" returned: 0 in 0.832s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Temporary image 22e76a71-372d-4748-bc00-afb5725ee06e is fetched for user 04d2224e74f74c74af3ec395f8347183. {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[4864b580-5aa9-4b20-9d6c-7d4346138a20]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:28 devstack sudo[84991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD Apr 13 11:00:28 devstack sudo[84991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:29 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0" returned: 0 in 0.857s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:29 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:00:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:29 devstack sudo[84996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 Apr 13 11:00:29 devstack sudo[84996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:29 devstack sudo[84991]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD" returned: 0 in 0.992s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:32 devstack sudo[84996]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83" returned: 0 in 3.927s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:32 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ca449e-6bbd-47ee-8d3a-8b7f3091dd23]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:33 devstack sudo[85058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 Apr 13 11:00:33 devstack sudo[85058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:33 devstack sudo[85058]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0" returned: 0 in 0.948s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:33 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0, size 1024.00 MB, duration 3.93 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:00:33 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Converted 1024.00 MB image at 260.66 MB/s Apr 13 11:00:33 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:00:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:33 devstack sudo[85063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 Apr 13 11:00:33 devstack sudo[85063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:34 devstack sudo[85063]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83" returned: 0 in 0.510s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Lock "cinder-quobyte-c79b9b52-9c19-465d-b6f3-ee623942da83" released by "_copy_volume_from_snapshot" :: held 7.550s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Acquiring lock "cinder-quobyte-9d0452b2-8a80-4845-842e-25a7227cd18e" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Lock "cinder-quobyte-9d0452b2-8a80-4845-842e-25a7227cd18e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Deleting offline snapshot 9d0452b2-8a80-4845-842e-25a7227cd18e of volume 504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:00:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] snapshot_file for this snap is: volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:00:34 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1220767-8e92-4b29-9f1b-2521b05003c0]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:34 devstack sudo[85066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e Apr 13 11:00:34 devstack sudo[85066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:35 devstack sudo[85066]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e" returned: 0 in 0.697s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-504ba8a0-d855-4012-a306-0b4debf34ba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:00:35 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be8a58e-fb60-4dae-adcf-53ecb9e8ff15]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:35 devstack sudo[85071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 Apr 13 11:00:35 devstack sudo[85071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:36 devstack sudo[85071]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0" returned: 0 in 0.791s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:36 devstack sudo[85076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e Apr 13 11:00:36 devstack sudo[85076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Flow 'volume_create_manager' (274c6b53-9ad7-48f3-8459-a4da8ec0b32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca4428c-9f9c-4615-9a56-bd0f978fb442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca4428c-9f9c-4615-9a56-bd0f978fb442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1410630189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9bf8be3-1f69-4308-adb6-74aa1ed42b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b246ae7bd4284b058675fd2750f882cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:36Z,use_quota=True,user_id='94951b0b83664e71a78e860bab36d0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00f67e3-2981-4a59-9eb9-32f5707edf62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a00f67e3-2981-4a59-9eb9-32f5707edf62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ab5ba9-8296-46c8-921a-4f13fdce58e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4ab5ba9-8296-46c8-921a-4f13fdce58e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9bf8be3-1f69-4308-adb6-74aa1ed42b2b', 'volume_name': 'volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4e0457-1f48-45d0-b026-a36de2e035a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d4e0457-1f48-45d0-b026-a36de2e035a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caf2c7d-7041-4e24-a201-8010854f9641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:36 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Volume d9bf8be3-1f69-4308-adb6-74aa1ed42b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b', 'volume_size': 1} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:36 devstack sudo[85076]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e" returned: 0 in 0.635s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:36 devstack sudo[85081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e Apr 13 11:00:36 devstack sudo[85081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:37 devstack sudo[85081]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0.9d0452b2-8a80-4845-842e-25a7227cd18e" returned: 0 in 0.431s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Lock "cinder-quobyte-9d0452b2-8a80-4845-842e-25a7227cd18e" released by "_delete_snapshot" :: held 2.636s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.689s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.750s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-882052836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49849b2-be45-4dc2-9e09-9ea66cef593d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002cae5f98a449fc83759cc84b3196cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:26Z,use_quota=True,user_id='c5152d606b0049a087f6d0df915d35ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Creating volume b49849b2-be45-4dc2-9e09-9ea66cef593d {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:37 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:37 devstack sudo[85116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d 1073741824 Apr 13 11:00:37 devstack sudo[85116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:37 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-46a2f504-7068-424b-8358-2ff40399046f tempest-GroupsV314Test-1715432989 None] Create group from source-group-57404a69-b910-4902-a7bb-ee093fb2a470 completed successfully. Apr 13 11:00:37 devstack sudo[85116]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d 1073741824" returned: 0 in 0.644s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:37 devstack sudo[85124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d Apr 13 11:00:37 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Acquiring lock "cinder-quobyte-c79b9b52-9c19-465d-b6f3-ee623942da83" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Lock "cinder-quobyte-c79b9b52-9c19-465d-b6f3-ee623942da83" acquired by "delete_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af8fda7-f65c-46d6-8467-904d3af282f4]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:38 devstack sudo[85126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 Apr 13 11:00:38 devstack sudo[85126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:38 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d" returned: 0 in 0.465s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] <== create_volume: return (1147ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.151s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.712s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:26Z,deleted=False,deleted_at=None,display_description='',display_name='',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3c67c065974df5a71d3d42a7c5e244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:26Z,use_quota=True,user_id='04d2224e74f74c74af3ec395f8347183',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Creating volume e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:38 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25dbdc19-eb35-4eed-8287-2cc6b0204b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49849b2-be45-4dc2-9e09-9ea66cef593d', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:38 devstack sudo[85129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 1073741824 Apr 13 11:00:38 devstack sudo[85129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ce0357-eaa4-46f7-8888-36b988109d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Volume volume-b49849b2-be45-4dc2-9e09-9ea66cef593d (b49849b2-be45-4dc2-9e09-9ea66cef593d): created successfully Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52ce0357-eaa4-46f7-8888-36b988109d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Flow 'volume_create_manager' (9c54e574-4fe0-4cd2-8355-6cbffcf8eac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:38 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d45a427e-fdec-4cb8-a5a1-8b9016356fda tempest-ServersNegativeTestJSON-92380894 None] Created volume successfully. Apr 13 11:00:38 devstack sudo[85126]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83" returned: 0 in 0.523s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:38 devstack sudo[85134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83 Apr 13 11:00:38 devstack sudo[85134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:38 devstack sudo[85139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:38 devstack sudo[85139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:38 devstack sudo[85129]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 1073741824" returned: 0 in 0.623s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:38 devstack sudo[85134]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c79b9b52-9c19-465d-b6f3-ee623942da83" returned: 0 in 0.465s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Lock "cinder-quobyte-c79b9b52-9c19-465d-b6f3-ee623942da83" released by "delete_volume" :: held 1.031s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:39 devstack sudo[85142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:00:39 devstack sudo[85142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Created reservations ['ac24da94-d24b-4a73-a7ea-62781ff14029'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:39 devstack cinder-volume[82656]: WARNING cinder.quota [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-682094633 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-682094633, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:00:39 devstack cinder-volume[82656]: WARNING cinder.quota [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-682094633 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-682094633, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Created reservations ['f751f66f-56f3-4634-ad7f-45fa978a7fde', 'd86b83c6-0379-443b-b897-6deac32c142e', 'f7c6b409-69dd-46ef-a71e-e8515c190f55', 'bf24142d-8b12-4abf-a08d-937cc49c8e1d'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:39 devstack sudo[85144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:39 devstack sudo[85144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:39 devstack sudo[85139]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.729s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:39 devstack sudo[85142]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 0 in 0.652s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] <== create_volume: return (1315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.239s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1410630189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9bf8be3-1f69-4308-adb6-74aa1ed42b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b246ae7bd4284b058675fd2750f882cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:36Z,use_quota=True,user_id='94951b0b83664e71a78e860bab36d0db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Creating volume d9bf8be3-1f69-4308-adb6-74aa1ed42b2b {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:39 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:39 devstack sudo[85149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b 1073741824 Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Attempting download of 22e76a71-372d-4748-bc00-afb5725ee06e ((None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}])) to volume e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1. {{(pid=82656) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 11:00:39 devstack sudo[85149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:39 devstack sudo[85144]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c6a41a86-4ca1-40bf-a8ed-9d1f97bc2d9e tempest-GroupsV314Test-1715432989 None] Delete group completed successfully. Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[746dac59-6085-49ec-a497-d01849e346dd]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_458tgowa {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:39 devstack sudo[85151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_458tgowa Apr 13 11:00:39 devstack sudo[85151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Flow 'volume_create_manager' (ced51546-499c-44a1-a2b9-288f0264c6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9001159-8a2b-496b-8680-3111f19fa80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9001159-8a2b-496b-8680-3111f19fa80e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1654766828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002cae5f98a449fc83759cc84b3196cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:40Z,use_quota=True,user_id='c5152d606b0049a087f6d0df915d35ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6192c041-7492-4503-8e3a-204077059e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6192c041-7492-4503-8e3a-204077059e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b910ea7-17bf-4363-a644-3cf47afe2366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b910ea7-17bf-4363-a644-3cf47afe2366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e', 'volume_name': 'volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee28cf0d-fbc5-4c7f-8939-de3f25aabc63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee28cf0d-fbc5-4c7f-8939-de3f25aabc63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f79529f-a7c0-41a2-98af-36a281563f9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:40 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Volume adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e', 'volume_size': 1} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:40 devstack sudo[85149]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b 1073741824" returned: 0 in 0.742s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:40 devstack sudo[85151]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_458tgowa" returned: 0 in 0.714s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_458tgowa {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:40 devstack sudo[85158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b Apr 13 11:00:40 devstack sudo[85158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Acquiring lock "cinder-quobyte-504ba8a0-d855-4012-a306-0b4debf34ba0" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Lock "cinder-quobyte-504ba8a0-d855-4012-a306-0b4debf34ba0" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa5d091-b00b-403b-8fe8-433ef9eed078]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:40 devstack sudo[85159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_458tgowa Apr 13 11:00:40 devstack sudo[85159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:40 devstack sudo[85161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 Apr 13 11:00:40 devstack sudo[85161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:40 devstack sudo[85158]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b" returned: 0 in 0.525s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] <== create_volume: return (1291ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.623s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1654766828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='002cae5f98a449fc83759cc84b3196cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:40Z,use_quota=True,user_id='c5152d606b0049a087f6d0df915d35ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Creating volume adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:40 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caf2c7d-7041-4e24-a201-8010854f9641) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:40 devstack sudo[85159]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587c8330-e5b8-4050-9cef-8d21b2ab9d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_458tgowa" returned: 1 in 0.532s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_458tgowa' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:00:40 devstack sudo[85167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e 1073741824 Apr 13 11:00:40 devstack sudo[85167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:40 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Volume volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b (d9bf8be3-1f69-4308-adb6-74aa1ed42b2b): created successfully Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587c8330-e5b8-4050-9cef-8d21b2ab9d0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Flow 'volume_create_manager' (274c6b53-9ad7-48f3-8459-a4da8ec0b32c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b75bc12-f71e-441c-a37d-a1e3e4aad842]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:40 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-87d0d94a-0c3f-4857-9ef5-f5ac71e528ae tempest-VolumesServicesTestJSON-929076087 None] Created volume successfully. Apr 13 11:00:41 devstack sudo[85161]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0" returned: 0 in 0.526s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:41 devstack sudo[85172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD Apr 13 11:00:41 devstack sudo[85172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:41 devstack sudo[85173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0 Apr 13 11:00:41 devstack sudo[85173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:41 devstack sudo[85172]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] 22e76a71-372d-4748-bc00-afb5725ee06e was qcow2, converting to raw {{(pid=82656) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:41 devstack sudo[85184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:00:41 devstack sudo[85184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:41 devstack sudo[85167]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e 1073741824" returned: 0 in 0.625s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:41 devstack sudo[85188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e Apr 13 11:00:41 devstack sudo[85188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Acquiring lock "cinder-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Lock "cinder-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:41 devstack sudo[85173]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Acquiring lock "cinder-quobyte-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-504ba8a0-d855-4012-a306-0b4debf34ba0" returned: 0 in 0.927s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Lock "cinder-quobyte-504ba8a0-d855-4012-a306-0b4debf34ba0" released by "delete_volume" :: held 1.490s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Lock "cinder-quobyte-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b" acquired by "delete_volume" :: waited 0.052s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[df52e61d-1a49-418d-87c9-baf113aa9410]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Created reservations ['bf1caf21-841d-4521-bf1e-853b6a92f939'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Created reservations ['ef0d6758-7114-40fc-808c-d128f224772a', '0fabe4d4-9740-45d0-bf8a-b675f6334242', '360b7a04-04b2-45de-8363-d09be1c16731', 'f41b528f-cdad-4772-b31a-60031c3b22a8'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:42 devstack sudo[85190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b Apr 13 11:00:42 devstack sudo[85190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:42 devstack sudo[85192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:42 devstack sudo[85192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:42 devstack sudo[85188]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e" returned: 0 in 0.919s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.614s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f79529f-a7c0-41a2-98af-36a281563f9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f96823-66f0-412b-ab9b-ea4a438c7fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:42 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Volume volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e (adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e): created successfully Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41f96823-66f0-412b-ab9b-ea4a438c7fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Flow 'volume_create_manager' (ced51546-499c-44a1-a2b9-288f0264c6f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-614d51a4-3b85-4cee-ae91-9dbd3e461309 tempest-ServersNegativeTestJSON-92380894 None] Created volume successfully. Apr 13 11:00:43 devstack sudo[85190]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b" returned: 0 in 1.115s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:43 devstack sudo[85209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b Apr 13 11:00:43 devstack sudo[85209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:43 devstack sudo[85192]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.985s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c4e29ffe-f296-4374-ab65-a9c4d6e0aa58 tempest-GroupsV314Test-1715432989 None] Delete group completed successfully. Apr 13 11:00:43 devstack sudo[85184]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 0 in 1.972s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_koocdkskdevstack@QuobyteHD, size 112.00 MB, duration 1.97 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:00:43 devstack cinder-volume[82656]: INFO cinder.image.image_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Converted 112.00 MB image at 56.73 MB/s Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:43 devstack sudo[85211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 1G Apr 13 11:00:43 devstack sudo[85211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:43 devstack sudo[85209]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "cinder-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b" returned: 0 in 0.578s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Lock "cinder-quobyte-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b" released by "delete_volume" :: held 1.730s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Lock "cinder-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "cinder-quobyte-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Lock "cinder-quobyte-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e" acquired by "delete_volume" :: waited 0.023s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Created reservations ['5e96c7e4-4cc5-4165-8596-4359c9cc40c7', 'b19c63ce-676d-4936-971f-c88e9fa154f7', '978adba3-1910-499a-ad83-32ee7648b532', '02a2eb6a-c53b-412a-8b01-57b6af67e36a'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a60960-da11-47f9-a77c-76a76252f8e1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:43 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:43 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:43 devstack sudo[85214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e Apr 13 11:00:43 devstack sudo[85214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:44 devstack sudo[85211]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 1G" returned: 0 in 0.597s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a105f1-af32-4016-a0d4-1dd816f53b18]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:44 devstack sudo[85221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:00:44 devstack sudo[85221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:44 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.523s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:44 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Deleted volume successfully. Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ccb3cb3-0f30-492b-87ee-9fdda288f7c4 tempest-VolumesServicesTestJSON-929076087 None] Lock "cinder-d9bf8be3-1f69-4308-adb6-74aa1ed42b2b-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:44 devstack sudo[85214]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e" returned: 0 in 0.673s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:44 devstack sudo[85227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e Apr 13 11:00:44 devstack sudo[85227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:44 devstack sudo[85221]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 0 in 0.663s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:44 devstack sudo[85231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:00:44 devstack sudo[85231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:45 devstack sudo[85227]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e" returned: 0 in 0.560s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Lock "cinder-quobyte-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e" released by "delete_volume" :: held 1.265s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Created reservations ['8581c84a-ba04-41ae-b888-91defa4d185c', '95595f3b-3117-4769-82db-daf29da1645c', 'b3265801-a4b7-46aa-b0a2-5ff97afda8d7', '41160e9e-df2c-41d7-a898-24ee5ef72b0d'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:45 devstack sudo[85234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:45 devstack sudo[85234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:45 devstack sudo[85231]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 1 in 0.624s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Downloaded image 22e76a71-372d-4748-bc00-afb5725ee06e ((None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}])) to volume e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 successfully. {{(pid=82656) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Temporary image 22e76a71-372d-4748-bc00-afb5725ee06e for user 04d2224e74f74c74af3ec395f8347183 is deleted. {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Marking volume e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 as bootable. {{(pid=82656) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Copying metadata from image 22e76a71-372d-4748-bc00-afb5725ee06e to e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1. {{(pid=82656) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Creating volume glance metadata for volume e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 backed by image 22e76a71-372d-4748-bc00-afb5725ee06e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82656) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a38a0fc-9d64-4eb9-8daf-790051e242a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ce768e-899b-473c-a9a8-f019f734e569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:45 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Volume volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 (e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1): created successfully Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6ce768e-899b-473c-a9a8-f019f734e569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Flow 'volume_create_manager' (1f567919-763b-4cd0-aad5-ff8241a36518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-5f85f174-518a-472c-bfba-1d75a6c44d43 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Created volume successfully. Apr 13 11:00:45 devstack sudo[85234]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.592s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Deleted volume successfully. Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-380d74e4-2b06-4352-a00e-5c1475b7b53d tempest-ServersNegativeTestJSON-92380894 None] Lock "cinder-adfe2a58-2b64-4ca7-acc3-0d9c21b6a15e-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "cinder-b49849b2-be45-4dc2-9e09-9ea66cef593d-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Lock "cinder-b49849b2-be45-4dc2-9e09-9ea66cef593d-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "cinder-quobyte-b49849b2-be45-4dc2-9e09-9ea66cef593d" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Lock "cinder-quobyte-b49849b2-be45-4dc2-9e09-9ea66cef593d" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:46 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d63848-82f5-4e21-ab6b-af2a4fb49022]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:46 devstack sudo[85240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d Apr 13 11:00:46 devstack sudo[85240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:46 devstack sudo[85240]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d" returned: 0 in 0.602s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:46 devstack sudo[85245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d Apr 13 11:00:46 devstack sudo[85245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:47 devstack sudo[85245]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b49849b2-be45-4dc2-9e09-9ea66cef593d" returned: 0 in 0.540s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Lock "cinder-quobyte-b49849b2-be45-4dc2-9e09-9ea66cef593d" released by "delete_volume" :: held 1.186s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Flow 'volume_create_manager' (c22e61c8-cc66-453f-8831-88c9145eb743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c7dd94-7beb-43c7-a992-a0e43118029e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5c7dd94-7beb-43c7-a992-a0e43118029e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-189689367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6579f5e-a175-4bc7-8aad-2bf8215c8aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d55c4da074a76ac7f91eef99f38df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:47Z,use_quota=True,user_id='5c4cde981f11484e899cfc33a5e6ce80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3590a84b-0cc7-47ea-9cdd-f46259d58304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3590a84b-0cc7-47ea-9cdd-f46259d58304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d012f8ae-23c4-4edd-9e9f-a511f02c6bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d012f8ae-23c4-4edd-9e9f-a511f02c6bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6579f5e-a175-4bc7-8aad-2bf8215c8aa6', 'volume_name': 'volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215bdc01-8758-410b-bd77-44171d289339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215bdc01-8758-410b-bd77-44171d289339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6326f9bd-732a-421a-b9ce-52416cba4f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:47 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6', 'volume_size': 1} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-189689367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6579f5e-a175-4bc7-8aad-2bf8215c8aa6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fa9d55c4da074a76ac7f91eef99f38df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:47Z,use_quota=True,user_id='5c4cde981f11484e899cfc33a5e6ce80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Creating volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:47 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:47 devstack sudo[85248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 1073741824 Apr 13 11:00:47 devstack sudo[85248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Created reservations ['6ee2eda6-f85f-42e8-bf10-85e7a606935f', '86f25aac-d927-4008-bff3-f8ddde0f3cc1', 'c5b857dc-fc51-4b32-b552-122f080e265d', '192c8087-4ef7-4c1a-b912-1d794ccc2002'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:47 devstack sudo[85250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:47 devstack sudo[85250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:47 devstack sudo[85248]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 1073741824" returned: 0 in 0.576s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:47 devstack sudo[85250]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.521s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:47 devstack sudo[85257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 Apr 13 11:00:47 devstack sudo[85257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:47 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Deleted volume successfully. Apr 13 11:00:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7df92867-6be8-4cc6-b989-a01c1fcecad7 tempest-ServersNegativeTestJSON-92380894 None] Lock "cinder-b49849b2-be45-4dc2-9e09-9ea66cef593d-delete_volume" released by "delete_volume" :: held 1.998s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:48 devstack sudo[85257]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" returned: 0 in 0.510s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.119s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6326f9bd-732a-421a-b9ce-52416cba4f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd75b680-6acc-4b46-ba14-9ad32170f5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Volume volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 (e6579f5e-a175-4bc7-8aad-2bf8215c8aa6): created successfully Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd75b680-6acc-4b46-ba14-9ad32170f5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Flow 'volume_create_manager' (c22e61c8-cc66-453f-8831-88c9145eb743) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:48 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-67ba88eb-73ee-4b9d-8003-93714a5d2d0b tempest-SnapshotsActionsTest-1020043812 None] Created volume successfully. Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[232409b5-9184-410e-bb84-ba8697ec0068]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Flow 'volume_create_manager' (470e0baa-74aa-4a47-b0e3-82e7c6e245bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d2a21c-cb68-4c7a-89a3-9853d963160c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:48 devstack sudo[85269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:00:48 devstack sudo[85269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41d2a21c-cb68-4c7a-89a3-9853d963160c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1521244905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bf4e81-5542-4b15-9dcd-afc6288e6dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edebfe7ae4c9427db5ef0688ef2537f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:49Z,use_quota=True,user_id='24e19f970ddd4326947ce4281aedad69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47bbe331-8a6b-4a4e-b2b1-350052913a4d),volume_type_id=47bbe331-8a6b-4a4e-b2b1-350052913a4d)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6be370b-2d51-455f-b5f9-476796ca3ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6be370b-2d51-455f-b5f9-476796ca3ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4899d53a-66bd-4bf6-b706-8aad8406bb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4899d53a-66bd-4bf6-b706-8aad8406bb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bf4e81-5542-4b15-9dcd-afc6288e6dab', 'volume_name': 'volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2c9990-7c61-4c84-9a15-8bd51b97c959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c2c9990-7c61-4c84-9a15-8bd51b97c959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663ad07a-367d-42e2-98a3-239e3a4831a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Volume 38bf4e81-5542-4b15-9dcd-afc6288e6dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab', 'volume_size': 1} Apr 13 11:00:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:49 devstack sudo[85269]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 0 in 0.546s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:49 devstack sudo[85273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:00:49 devstack sudo[85273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:49 devstack sudo[85273]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 1 in 0.715s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.322s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.159s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1521244905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bf4e81-5542-4b15-9dcd-afc6288e6dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='edebfe7ae4c9427db5ef0688ef2537f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:00:49Z,use_quota=True,user_id='24e19f970ddd4326947ce4281aedad69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47bbe331-8a6b-4a4e-b2b1-350052913a4d),volume_type_id=47bbe331-8a6b-4a4e-b2b1-350052913a4d)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Creating volume 38bf4e81-5542-4b15-9dcd-afc6288e6dab {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:00:49 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:49 devstack sudo[85298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab 1073741824 Apr 13 11:00:49 devstack sudo[85298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e', 'name': 'volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a6b470f0-58d7-4fcb-afc2-11a32e95d867', 'enforce_multipath': True} {{(pid=82656) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Apr 13 11:00:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:49 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-db8d5051-3952-403e-a37c-5d9491af2041 req-51b8d010-578b-4612-b9bc-821f0eae0998 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] attachment_update completed successfully. Apr 13 11:00:50 devstack sudo[85298]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab 1073741824" returned: 0 in 0.673s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:50 devstack sudo[85307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab Apr 13 11:00:50 devstack sudo[85307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:50 devstack sudo[85307]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab" returned: 0 in 0.488s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] <== create_volume: return (1196ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:00:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.034s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (663ad07a-367d-42e2-98a3-239e3a4831a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e33690f-38cb-4e43-9c26-7f9bad097338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Creating offline snapshot 217c338b-7801-4258-adb4-ce5357276482 of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:00:51 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Volume volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab (38bf4e81-5542-4b15-9dcd-afc6288e6dab): created successfully Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e33690f-38cb-4e43-9c26-7f9bad097338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Flow 'volume_create_manager' (470e0baa-74aa-4a47-b0e3-82e7c6e245bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea6af0e6-b0c6-4154-b6c6-b36b8a37b1d2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:51 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6f1a782b-ff55-4c55-bc40-70f2787102fd tempest-VolumeTypesAccessTest-1190573559 None] Created volume successfully. Apr 13 11:00:51 devstack sudo[85314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 Apr 13 11:00:51 devstack sudo[85314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:51 devstack sudo[85314]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" returned: 0 in 0.525s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:51 devstack sudo[85320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 1G Apr 13 11:00:51 devstack sudo[85320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Acquiring lock "cinder-38bf4e81-5542-4b15-9dcd-afc6288e6dab-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Lock "cinder-38bf4e81-5542-4b15-9dcd-afc6288e6dab-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Acquiring lock "cinder-quobyte-38bf4e81-5542-4b15-9dcd-afc6288e6dab" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Lock "cinder-quobyte-38bf4e81-5542-4b15-9dcd-afc6288e6dab" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cee3f7d-8b48-47ab-aa87-f63b60c1f27f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:51 devstack sudo[85323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab Apr 13 11:00:51 devstack sudo[85323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:52 devstack sudo[85320]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 1G" returned: 0 in 0.548s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:52 devstack sudo[85329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:00:52 devstack sudo[85329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:52 devstack sudo[85323]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab" returned: 0 in 0.559s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:52 devstack sudo[85334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab Apr 13 11:00:52 devstack sudo[85334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:52 devstack sudo[85329]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.479s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:52 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 is being set with open permissions: ugo+rw Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:52 devstack sudo[85339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:00:52 devstack sudo[85339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:52 devstack sudo[85334]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-38bf4e81-5542-4b15-9dcd-afc6288e6dab" returned: 0 in 0.490s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Lock "cinder-quobyte-38bf4e81-5542-4b15-9dcd-afc6288e6dab" released by "delete_volume" :: held 1.085s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:52 devstack cinder-volume[82656]: WARNING cinder.quota [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1980082244 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1980082244, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:00:52 devstack cinder-volume[82656]: WARNING cinder.quota [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1980082244 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1980082244, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:00:52 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Created reservations ['ec0bb8ea-6c38-41e8-b293-e99c9c550caa', '36b54166-6e07-4f44-9635-1e1604b517fe', '3c0475de-74c2-4536-8c97-8aaba4bee77c', 'c45b6295-5811-4e2b-9d34-d034d0271231'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:53 devstack sudo[85346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:00:53 devstack sudo[85346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:53 devstack sudo[85339]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.459s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:53 devstack sudo[85348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.info Apr 13 11:00:53 devstack sudo[85348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:53 devstack sudo[85346]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.452s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:00:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Deleted volume successfully. Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=98,cinder:UPDATE=126,cinder:DELETE=9,cinder:INSERT=44 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-33ac41e7-f24d-4956-9e1a-57d015d431a6 tempest-VolumeTypesAccessTest-1190573559 None] Lock "cinder-38bf4e81-5542-4b15-9dcd-afc6288e6dab-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:00:53 devstack sudo[85348]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.info" returned: 0 in 0.498s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:53 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.info is being set with open permissions: ugo+rw Apr 13 11:00:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:53 devstack sudo[85352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.info Apr 13 11:00:53 devstack sudo[85352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:54 devstack sudo[85352]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.info" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.058s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d7f7f0d4-f340-4343-aed0-8b94524f4afc tempest-SnapshotsActionsTest-1020043812 None] Create snapshot completed successfully Apr 13 11:00:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:00:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:00:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Creating offline snapshot cc5b1f7d-ab3f-44d5-800e-318b11e8b114 of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:00:56 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d4f73b-0c0d-4647-9729-831a4d2d19e0]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:00:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:56 devstack sudo[85381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:00:56 devstack sudo[85381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:56 devstack sudo[85381]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.625s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:00:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:56 devstack sudo[85387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 1G Apr 13 11:00:56 devstack sudo[85387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:57 devstack sudo[85387]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 1G" returned: 0 in 0.890s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:57 devstack sudo[85394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 Apr 13 11:00:57 devstack sudo[85394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:58 devstack sudo[85394]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114" returned: 0 in 0.689s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:58 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 is being set with open permissions: ugo+rw Apr 13 11:00:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:00:58 devstack sudo[85399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 Apr 13 11:00:58 devstack sudo[85399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:00:59 devstack sudo[85399]: pam_unix(sudo:session): session closed for user root Apr 13 11:00:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114" returned: 0 in 0.773s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:00:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.148s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:00:59 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-a9bf362a-658d-47f1-8d2f-ff678a56ef88 tempest-SnapshotsActionsTest-1020043812 None] Create snapshot completed successfully Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-cc5b1f7d-ab3f-44d5-800e-318b11e8b114-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-cc5b1f7d-ab3f-44d5-800e-318b11e8b114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" acquired by "delete_snapshot" :: waited 0.023s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-quobyte-cc5b1f7d-ab3f-44d5-800e-318b11e8b114" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-cc5b1f7d-ab3f-44d5-800e-318b11e8b114" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Deleting offline snapshot cc5b1f7d-ab3f-44d5-800e-318b11e8b114 of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] snapshot_file for this snap is: volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0fb037-ca29-4a7d-bab6-f10ce7991a40]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:00 devstack sudo[85404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 Apr 13 11:01:00 devstack sudo[85404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:01 devstack sudo[85404]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114" returned: 0 in 0.781s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:01 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3026ad-9d77-454c-9f0e-48818c3ebd4b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:01 devstack sudo[85410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:01 devstack sudo[85410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:02 devstack sudo[85410]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.965s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:02 devstack sudo[85416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 Apr 13 11:01:02 devstack sudo[85416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:02 devstack sudo[85416]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114" returned: 0 in 0.757s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:02 devstack sudo[85427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114 Apr 13 11:01:02 devstack sudo[85427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:03 devstack sudo[85427]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.cc5b1f7d-ab3f-44d5-800e-318b11e8b114" returned: 0 in 0.653s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-cc5b1f7d-ab3f-44d5-800e-318b11e8b114" released by "_delete_snapshot" :: held 3.239s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" released by "delete_snapshot" :: held 3.270s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:03 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=105,cinder:UPDATE=113,cinder:INSERT=20,cinder:DELETE=10 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:01:03 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Created reservations ['5faa298e-c814-4ef1-8fd3-9c137af650ba', '5676f6f4-a566-4d51-92b3-3883e1ce094b', '1b99457a-e582-4898-afd7-325bd4b4eb27', '461eac2b-0a0f-44e1-bfe3-ffe3955d4b3c'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Delete snapshot completed successfully. Apr 13 11:01:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46312530-51ff-4f9d-aa71-156c880c2401 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-cc5b1f7d-ab3f-44d5-800e-318b11e8b114-delete_snapshot" released by "delete_snapshot" :: held 3.414s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Creating offline snapshot 26d33919-c71d-4311-b0f4-7b01627351e6 of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:01:04 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f417ee0e-83db-4627-af86-fe7533a5eb69]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:04 devstack sudo[85461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:04 devstack sudo[85461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:05 devstack sudo[85461]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.531s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:05 devstack sudo[85475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 1G Apr 13 11:01:05 devstack sudo[85475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:05 devstack sudo[85475]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 1G" returned: 0 in 0.598s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:06 devstack sudo[85480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 Apr 13 11:01:06 devstack sudo[85480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-979a014a-28b1-4d4a-aa15-eb3e8e78665a tempest-BackendsCapabilitiesAdminTestsJSON-101129173 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82656) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 11:01:06 devstack sudo[85480]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:06 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 is being set with open permissions: ugo+rw Apr 13 11:01:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:06 devstack sudo[85485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 Apr 13 11:01:06 devstack sudo[85485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a80be6fc-560c-42fd-85c9-019aacb92f35 tempest-BackendsCapabilitiesAdminTestsJSON-101129173 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7579956054688, 'free_capacity_gb': 1775.7579956054688, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82656) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Apr 13 11:01:07 devstack sudo[85485]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6" returned: 0 in 0.538s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:07 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9a63e791-07e3-4f93-9827-b039446feb38 tempest-SnapshotsActionsTest-1020043812 None] Create snapshot completed successfully Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-26d33919-c71d-4311-b0f4-7b01627351e6-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-26d33919-c71d-4311-b0f4-7b01627351e6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-quobyte-26d33919-c71d-4311-b0f4-7b01627351e6" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-26d33919-c71d-4311-b0f4-7b01627351e6" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Deleting offline snapshot 26d33919-c71d-4311-b0f4-7b01627351e6 of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] snapshot_file for this snap is: volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[576493bb-cff0-405f-a7e4-870e052cb1b2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:08 devstack sudo[85489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 Apr 13 11:01:08 devstack sudo[85489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Flow 'volume_create_manager' (2a492a85-0ade-40a7-a025-ba4b851b2bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec310f1-c92c-4472-99f3-7a755d073dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bec310f1-c92c-4472-99f3-7a755d073dc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1261685189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fce2264-e607-45a1-b5e3-a24ce49e1017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f23510e17504742a4835fc2b633f963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:09Z,use_quota=True,user_id='86ab7d817f004faeaa56f9bcd207a2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393b0fb9-f567-4bd9-a550-176b2a0432a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (393b0fb9-f567-4bd9-a550-176b2a0432a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0841f57d-8c82-46b2-8b63-2cf1b162c364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0841f57d-8c82-46b2-8b63-2cf1b162c364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fce2264-e607-45a1-b5e3-a24ce49e1017', 'volume_name': 'volume-0fce2264-e607-45a1-b5e3-a24ce49e1017', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2289bc-570d-4673-82d0-be39921ef93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e2289bc-570d-4673-82d0-be39921ef93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2fc455-d5f8-4b90-9d65-14a14fb09161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:08 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Volume 0fce2264-e607-45a1-b5e3-a24ce49e1017: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fce2264-e607-45a1-b5e3-a24ce49e1017', 'volume_size': 1} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1261685189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0fce2264-e607-45a1-b5e3-a24ce49e1017,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f23510e17504742a4835fc2b633f963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:09Z,use_quota=True,user_id='86ab7d817f004faeaa56f9bcd207a2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Creating volume 0fce2264-e607-45a1-b5e3-a24ce49e1017 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:01:08 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:08 devstack sudo[85495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 1073741824 Apr 13 11:01:08 devstack sudo[85495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:08 devstack sudo[85489]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6" returned: 0 in 0.658s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ccd7c1-dc54-43da-84d4-e4181a0e9ab8]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:08 devstack sudo[85497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:08 devstack sudo[85497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:09 devstack sudo[85495]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 1073741824" returned: 0 in 0.796s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:09 devstack sudo[85497]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.722s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:09 devstack sudo[85532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 Apr 13 11:01:09 devstack sudo[85532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:09 devstack sudo[85531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 Apr 13 11:01:09 devstack sudo[85531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:10 devstack sudo[85532]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017" returned: 0 in 0.762s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] <== create_volume: return (1640ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed2fc455-d5f8-4b90-9d65-14a14fb09161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fce2264-e607-45a1-b5e3-a24ce49e1017', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8692ea6e-a132-4012-b45b-58959f83743e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:10 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Volume volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 (0fce2264-e607-45a1-b5e3-a24ce49e1017): created successfully Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8692ea6e-a132-4012-b45b-58959f83743e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Flow 'volume_create_manager' (2a492a85-0ade-40a7-a025-ba4b851b2bf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:10 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-41ac3533-b815-47ab-8130-85106cea72c5 tempest-VolumesTransfersTest-544708019 None] Created volume successfully. Apr 13 11:01:10 devstack sudo[85531]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6" returned: 0 in 0.901s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:10 devstack sudo[85541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6 Apr 13 11:01:10 devstack sudo[85541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:11 devstack sudo[85541]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.26d33919-c71d-4311-b0f4-7b01627351e6" returned: 0 in 0.654s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-26d33919-c71d-4311-b0f4-7b01627351e6" released by "_delete_snapshot" :: held 3.023s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" released by "delete_snapshot" :: held 3.038s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Created reservations ['140080ce-36a6-49d7-8474-75e289588f2f', '50a95118-f9fb-4361-8aac-7de67f38d92e', 'a600ba33-92cd-4870-871d-d2c0a754310a', '42c0132d-dcdb-47b4-a17c-00546aed3fe0'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Delete snapshot completed successfully. Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8738ca9b-b4f9-4f60-9390-933257b6e699 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-26d33919-c71d-4311-b0f4-7b01627351e6-delete_snapshot" released by "delete_snapshot" :: held 3.203s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5cca210a-2945-47cc-b18f-c0fa89d47dea tempest-VolumesTransfersTest-1105457334 None] Transfer volume completed successfully. Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Creating offline snapshot a096faac-ae2b-43e2-a75f-5214e405f4cd of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d5d3beb-2349-449f-a473-f2aa8d65b1ce]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:11 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:11 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:12 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.832s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:12 devstack sudo[85570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd 1G Apr 13 11:01:12 devstack sudo[85570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Acquiring lock "cinder-0fce2264-e607-45a1-b5e3-a24ce49e1017-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Lock "cinder-0fce2264-e607-45a1-b5e3-a24ce49e1017-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Acquiring lock "cinder-quobyte-0fce2264-e607-45a1-b5e3-a24ce49e1017" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Lock "cinder-quobyte-0fce2264-e607-45a1-b5e3-a24ce49e1017" acquired by "delete_volume" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:13 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc28068d-bf96-4459-b32b-22ffc4337d42]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:13 devstack sudo[85573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 Apr 13 11:01:13 devstack sudo[85573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:13 devstack sudo[85570]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd 1G" returned: 0 in 0.853s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:13 devstack sudo[85578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd Apr 13 11:01:13 devstack sudo[85578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:13 devstack sudo[85573]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017" returned: 0 in 0.693s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:13 devstack sudo[85583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017 Apr 13 11:01:13 devstack sudo[85583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:14 devstack sudo[85578]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd" returned: 0 in 0.716s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:14 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd is being set with open permissions: ugo+rw Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:14 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd Apr 13 11:01:14 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:14 devstack sudo[85583]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0fce2264-e607-45a1-b5e3-a24ce49e1017" returned: 0 in 0.773s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Lock "cinder-quobyte-0fce2264-e607-45a1-b5e3-a24ce49e1017" released by "delete_volume" :: held 1.516s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Created reservations ['4d407fc1-920c-4fd0-89a2-508c31e414e2', '014c6dc9-cf25-454a-8e8f-ffdaa4f98b41', '43f64923-4b18-43e0-9541-00d6485e6005', 'c0c9c9d9-2413-41f1-bc2c-11679b74573f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:14 devstack sudo[85619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:14 devstack sudo[85619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:14 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd" returned: 0 in 0.657s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.137s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:14 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-13975423-a754-4a3c-ab8e-2506ceedbad5 tempest-SnapshotsActionsTest-1020043812 None] Create snapshot completed successfully Apr 13 11:01:15 devstack sudo[85619]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.610s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:15 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Deleted volume successfully. Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3db4bd52-b8fb-489d-be43-cb7028c7f6f1 tempest-VolumesTransfersTest-1844535628 None] Lock "cinder-0fce2264-e607-45a1-b5e3-a24ce49e1017-delete_volume" released by "delete_volume" :: held 2.341s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Flow 'volume_create_manager' (f1d35ba3-4271-42c6-ae39-5580a7cacba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b80013-316b-48fe-bfab-8d393618fea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b80013-316b-48fe-bfab-8d393618fea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1143100872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f611f22-8f11-4938-8b2c-8594897e4079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f23510e17504742a4835fc2b633f963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:16Z,use_quota=True,user_id='86ab7d817f004faeaa56f9bcd207a2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9753f41a-22e9-4f35-a718-7fea4c857abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9753f41a-22e9-4f35-a718-7fea4c857abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3becc2d9-4bad-4b11-988a-98864fbd3fba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3becc2d9-4bad-4b11-988a-98864fbd3fba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f611f22-8f11-4938-8b2c-8594897e4079', 'volume_name': 'volume-9f611f22-8f11-4938-8b2c-8594897e4079', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043ba2be-364f-47b6-b60f-11f3004c702e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (043ba2be-364f-47b6-b60f-11f3004c702e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8dd354-fac6-48c5-9b5c-a1fe66382ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:15 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Volume 9f611f22-8f11-4938-8b2c-8594897e4079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f611f22-8f11-4938-8b2c-8594897e4079', 'volume_size': 1} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1143100872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f611f22-8f11-4938-8b2c-8594897e4079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f23510e17504742a4835fc2b633f963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:16Z,use_quota=True,user_id='86ab7d817f004faeaa56f9bcd207a2de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Creating volume 9f611f22-8f11-4938-8b2c-8594897e4079 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:01:15 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:01:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:15 devstack sudo[85646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 1073741824 Apr 13 11:01:15 devstack sudo[85646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-a096faac-ae2b-43e2-a75f-5214e405f4cd-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-a096faac-ae2b-43e2-a75f-5214e405f4cd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-quobyte-a096faac-ae2b-43e2-a75f-5214e405f4cd" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-a096faac-ae2b-43e2-a75f-5214e405f4cd" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Deleting offline snapshot a096faac-ae2b-43e2-a75f-5214e405f4cd of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] snapshot_file for this snap is: volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d4f350-0d70-4118-bd11-7dfb4fffbbb1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:16 devstack sudo[85649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd Apr 13 11:01:16 devstack sudo[85649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-64cb5e78-07dc-4d6d-9b6c-2b4baddc3b5d tempest-GroupsV320Test-2102623853 None] Group tempest-GroupsV320Test-Group-1877838533: creating Apr 13 11:01:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-64cb5e78-07dc-4d6d-9b6c-2b4baddc3b5d tempest-GroupsV320Test-2102623853 None] Group tempest-GroupsV320Test-Group-1877838533: created successfully Apr 13 11:01:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-64cb5e78-07dc-4d6d-9b6c-2b4baddc3b5d tempest-GroupsV320Test-2102623853 None] Create group completed successfully. Apr 13 11:01:16 devstack sudo[85646]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 1073741824" returned: 0 in 0.990s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:16 devstack sudo[85655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 Apr 13 11:01:16 devstack sudo[85655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:16 devstack sudo[85649]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd" returned: 0 in 0.854s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bc150a-b697-4fa7-a5d3-b0e53c4adcb6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:17 devstack sudo[85660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:17 devstack sudo[85660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:17 devstack sudo[85655]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079" returned: 0 in 0.543s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8dd354-fac6-48c5-9b5c-a1fe66382ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f611f22-8f11-4938-8b2c-8594897e4079', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b862c3-b77d-432c-b64e-25d3c73fe88c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:17 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Volume volume-9f611f22-8f11-4938-8b2c-8594897e4079 (9f611f22-8f11-4938-8b2c-8594897e4079): created successfully Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b862c3-b77d-432c-b64e-25d3c73fe88c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Flow 'volume_create_manager' (f1d35ba3-4271-42c6-ae39-5580a7cacba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:17 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1138ae0b-3bc8-4419-a3ae-b02f6bcf53b5 tempest-VolumesTransfersTest-544708019 None] Created volume successfully. Apr 13 11:01:17 devstack sudo[85660]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.662s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:17 devstack sudo[85684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd Apr 13 11:01:17 devstack sudo[85684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Created reservations ['2623197a-f584-4367-9168-302716f5419a'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:18 devstack sudo[85688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:18 devstack sudo[85688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Acquiring lock "cinder-9f611f22-8f11-4938-8b2c-8594897e4079-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Lock "cinder-9f611f22-8f11-4938-8b2c-8594897e4079-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Acquiring lock "cinder-quobyte-9f611f22-8f11-4938-8b2c-8594897e4079" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Lock "cinder-quobyte-9f611f22-8f11-4938-8b2c-8594897e4079" acquired by "delete_volume" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ace842-3865-4f85-9c2f-917d62f9b92e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:18 devstack sudo[85693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 Apr 13 11:01:18 devstack sudo[85693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:18 devstack sudo[85684]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd" returned: 0 in 0.628s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:18 devstack sudo[85695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd Apr 13 11:01:18 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:18 devstack sudo[85688]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.492s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-89069131-020b-4ee9-9d2a-a0519939cbc5 tempest-GroupsV320Test-2102623853 None] Delete group completed successfully. Apr 13 11:01:18 devstack sudo[85693]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079" returned: 0 in 0.552s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:18 devstack sudo[85705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079 Apr 13 11:01:18 devstack sudo[85705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:18 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.a096faac-ae2b-43e2-a75f-5214e405f4cd" returned: 0 in 0.486s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-a096faac-ae2b-43e2-a75f-5214e405f4cd" released by "_delete_snapshot" :: held 2.696s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" released by "delete_snapshot" :: held 2.711s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Created reservations ['531aecd3-7c93-4fee-bcb7-b6a32ea6b3c9', '9b89672f-4cf1-4f67-8541-85548d5c3b58', '5d1b58d1-e679-4407-a53a-141fdf0ba72e', '7e41df89-0496-4abb-b366-bd4373307bb6'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Delete snapshot completed successfully. Apr 13 11:01:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0be253ec-ee8d-4519-910d-85bc4d6f8aa4 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-a096faac-ae2b-43e2-a75f-5214e405f4cd-delete_snapshot" released by "delete_snapshot" :: held 2.816s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:19 devstack sudo[85705]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9f611f22-8f11-4938-8b2c-8594897e4079" returned: 0 in 0.526s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Lock "cinder-quobyte-9f611f22-8f11-4938-8b2c-8594897e4079" released by "delete_volume" :: held 1.106s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Created reservations ['51d8cc78-a2df-4c5c-8f4e-5d016ca4efa4', '0c5d1e5d-15f2-4e5d-8893-fb39969e5294', '95a9dbc3-70dd-4cf6-ae2c-0c5b2d73b688', 'd00c0103-3f32-4012-99ab-23a1fb51e325'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:19 devstack sudo[85710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:19 devstack sudo[85710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Creating offline snapshot 51c5b07f-cc2d-4f71-8875-7ed3f4788d10 of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1953280a-ef68-42f9-903f-38e23995a5dc]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:19 devstack sudo[85712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:19 devstack sudo[85712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:19 devstack sudo[85710]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.491s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:19 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Deleted volume successfully. Apr 13 11:01:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c09632a8-21d8-464a-b886-564577dd1583 tempest-VolumesTransfersTest-1844535628 None] Lock "cinder-9f611f22-8f11-4938-8b2c-8594897e4079-delete_volume" released by "delete_volume" :: held 1.777s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:20 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-aa3e553e-752f-4eb4-acdd-5f554f363aa9 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Terminate volume connection completed successfully. Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-aa3e553e-752f-4eb4-acdd-5f554f363aa9 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Deleting attachment a6b470f0-58d7-4fcb-afc2-11a32e95d867. {{(pid=82656) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 11:01:20 devstack sudo[85712]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.598s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:20 devstack sudo[85718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 1G Apr 13 11:01:20 devstack sudo[85718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "cinder-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "cinder-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "cinder-quobyte-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "cinder-quobyte-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1beb2d8-4aff-498c-b6a6-16f0eab2d9f9]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:20 devstack sudo[85718]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 1G" returned: 0 in 0.676s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:20 devstack sudo[85724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 Apr 13 11:01:20 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:20 devstack sudo[85723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:01:20 devstack sudo[85723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:21 devstack sudo[85723]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 0 in 0.592s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:21 devstack sudo[85737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:01:21 devstack sudo[85737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:21 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10" returned: 0 in 0.726s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:21 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 is being set with open permissions: ugo+rw Apr 13 11:01:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:21 devstack sudo[85740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 Apr 13 11:01:21 devstack sudo[85740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:22 devstack sudo[85737]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 1 in 0.656s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:22 devstack sudo[85740]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10" returned: 0 in 0.549s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:22 devstack sudo[85747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1 Apr 13 11:01:22 devstack sudo[85747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.618s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:22 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ff0d34e2-c389-43ee-8491-ce7e11423bf4 tempest-SnapshotsActionsTest-1020043812 None] Create snapshot completed successfully Apr 13 11:01:22 devstack sudo[85747]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" returned: 0 in 0.558s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "cinder-quobyte-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1" released by "delete_volume" :: held 1.854s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.quota [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Created reservations ['0e1aaf49-8486-44a4-9501-438cec62042a', '89e40c63-18b6-428e-89ad-3833b6ac974c', '788f0d52-7b4d-4d17-ae0f-9c94f9a097a3', 'a575453b-82c0-40e2-932d-c9d46b60981d'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-51c5b07f-cc2d-4f71-8875-7ed3f4788d10-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-51c5b07f-cc2d-4f71-8875-7ed3f4788d10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" acquired by "delete_snapshot" :: waited 0.051s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Acquiring lock "cinder-quobyte-51c5b07f-cc2d-4f71-8875-7ed3f4788d10" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:22 devstack sudo[85750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:22 devstack sudo[85750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-51c5b07f-cc2d-4f71-8875-7ed3f4788d10" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Deleting offline snapshot 51c5b07f-cc2d-4f71-8875-7ed3f4788d10 of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] snapshot_file for this snap is: volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b992a894-ba46-4ad8-9b3c-c71438b36f5c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:23 devstack sudo[85752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 Apr 13 11:01:23 devstack sudo[85752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:23 devstack sudo[85750]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.539s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:23 devstack cinder-volume[82656]: DEBUG cinder.manager [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Deleted volume successfully. Apr 13 11:01:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-c55eb4a0-dbb2-42dc-9cde-694f91437fc2 req-d6c90d47-8649-4bcc-acd1-74e5e47e6c84 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "cinder-e6d88dcf-ab9e-458d-a9e0-791f4ebf55a1-delete_volume" released by "delete_volume" :: held 2.668s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:23 devstack sudo[85752]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10" returned: 0 in 0.669s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:23 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6596dd2-4b5d-4843-b208-4b4379a1f8f7]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:23 devstack sudo[85758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:23 devstack sudo[85758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:24 devstack sudo[85758]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.659s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:24 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:24 devstack sudo[85764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 Apr 13 11:01:24 devstack sudo[85764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:24 devstack sudo[85764]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10" returned: 0 in 0.590s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:24 devstack sudo[85769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10 Apr 13 11:01:24 devstack sudo[85769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Flow 'volume_create_manager' (dd19e7d1-37cb-4783-958f-40e33eb26a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b6e9aa-3daa-4d46-8f0a-d042b253731e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2b6e9aa-3daa-4d46-8f0a-d042b253731e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1356997456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ef4486-cc0f-41b3-930f-a79c722fec6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f5e827ad164073b186fd719bb0a7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:25Z,use_quota=True,user_id='32fbbbac2a2e43d1ada4e728da7cc8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73eff0fb-4777-48df-b89c-e7787a799c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73eff0fb-4777-48df-b89c-e7787a799c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2737c0-5b97-4c6a-8393-fb78db388d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.image.glance [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Creating Keystone auth plugin from conf {{(pid=82656) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 11:01:25 devstack sudo[85769]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.51c5b07f-cc2d-4f71-8875-7ed3f4788d10" returned: 0 in 0.640s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-51c5b07f-cc2d-4f71-8875-7ed3f4788d10" released by "_delete_snapshot" :: held 2.643s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" released by "delete_snapshot" :: held 2.664s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Created reservations ['b6e5a74e-a6e8-418a-9809-22bb2b34d0b7', '0ba3e3a0-823e-4aa8-8be6-eec42c926254', '011f9d8b-388f-44a7-a31c-acd96098cc78', '8d3900a2-9ef1-48e9-8454-573ff525c04b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:25 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Delete snapshot completed successfully. Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5983af0e-a5c5-496d-9d4a-9c82c94f7390 tempest-SnapshotsActionsTest-918822617 None] Lock "cinder-51c5b07f-cc2d-4f71-8875-7ed3f4788d10-delete_snapshot" released by "delete_snapshot" :: held 2.854s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f2737c0-5b97-4c6a-8393-fb78db388d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '04ef4486-cc0f-41b3-930f-a79c722fec6b', 'volume_name': 'volume-04ef4486-cc0f-41b3-930f-a79c722fec6b', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7992a456-73c7-4c4a-83fb-09116e235dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7992a456-73c7-4c4a-83fb-09116e235dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217dbd7c-3f19-4717-9aa3-2a156620ce8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:25 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Volume 04ef4486-cc0f-41b3-930f-a79c722fec6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-04ef4486-cc0f-41b3-930f-a79c722fec6b', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 11:01:25 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Trying to clone 04ef4486-cc0f-41b3-930f-a79c722fec6b from image 22e76a71-372d-4748-bc00-afb5725ee06e at location (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]). {{(pid=82656) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 11:01:26 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Image download 20.69 MB at 20.69 MB/s Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b8d687-b709-42ba-8fb3-87503beb59c2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:26 devstack sudo[85802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD Apr 13 11:01:26 devstack sudo[85802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "cinder-217c338b-7801-4258-adb4-ce5357276482-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-217c338b-7801-4258-adb4-ce5357276482-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "cinder-quobyte-217c338b-7801-4258-adb4-ce5357276482" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-quobyte-217c338b-7801-4258-adb4-ce5357276482" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Deleting offline snapshot 217c338b-7801-4258-adb4-ce5357276482 of volume e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] snapshot_file for this snap is: volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b107195-5814-4886-b2ea-024b194c97ec]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:26 devstack sudo[85805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:26 devstack sudo[85805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:26 devstack sudo[85802]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD" returned: 0 in 0.647s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Temporary image 22e76a71-372d-4748-bc00-afb5725ee06e is fetched for user 32fbbbac2a2e43d1ada4e728da7cc8d0. {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a41d07-ee5c-43aa-adf6-7e4c07b7de91]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:26 devstack sudo[85811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD Apr 13 11:01:26 devstack sudo[85811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:27 devstack sudo[85805]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.676s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[248fa4f2-0ca0-4b3b-96ca-de38107f5233]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Flow 'volume_create_manager' (bd2c7837-87b1-4f31-8e82-5876e58d52d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:27 devstack sudo[85817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 Apr 13 11:01:27 devstack sudo[85817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18fc2c6-6766-4f6c-b027-114a841c31f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18fc2c6-6766-4f6c-b027-114a841c31f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1804333126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213842e3-24d5-415a-acc4-bcd4d37f191c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48b80d37f27446daf2f14c859224f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:27Z,use_quota=True,user_id='20c03b33ff534bb8a924985d6ad23c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35421643-3e5c-4900-8461-3781a8c2fc31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35421643-3e5c-4900-8461-3781a8c2fc31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e493d888-9de9-43ae-90f0-14812beefa35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e493d888-9de9-43ae-90f0-14812beefa35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '213842e3-24d5-415a-acc4-bcd4d37f191c', 'volume_name': 'volume-213842e3-24d5-415a-acc4-bcd4d37f191c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a285ac-1e6d-4b5e-94ca-5506cc2a5041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a285ac-1e6d-4b5e-94ca-5506cc2a5041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a7492e-548e-4ef3-89ff-e2e0ce162dbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:27 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Volume 213842e3-24d5-415a-acc4-bcd4d37f191c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-213842e3-24d5-415a-acc4-bcd4d37f191c', 'volume_size': 1} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1804333126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=213842e3-24d5-415a-acc4-bcd4d37f191c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48b80d37f27446daf2f14c859224f23',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:27Z,use_quota=True,user_id='20c03b33ff534bb8a924985d6ad23c50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Creating volume 213842e3-24d5-415a-acc4-bcd4d37f191c {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:01:27 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:27 devstack sudo[85819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c 1073741824 Apr 13 11:01:27 devstack sudo[85819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:27 devstack sudo[85811]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD" returned: 0 in 0.543s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:27 devstack sudo[85817]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" returned: 0 in 0.492s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:27 devstack sudo[85831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:27 devstack sudo[85831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:27 devstack sudo[85819]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c 1073741824" returned: 0 in 0.508s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:27 devstack sudo[85833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c Apr 13 11:01:27 devstack sudo[85833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:28 devstack sudo[85831]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:28 devstack sudo[85838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482 Apr 13 11:01:28 devstack sudo[85838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:28 devstack sudo[85833]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c" returned: 0 in 0.449s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.872s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1356997456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04ef4486-cc0f-41b3-930f-a79c722fec6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f5e827ad164073b186fd719bb0a7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:25Z,use_quota=True,user_id='32fbbbac2a2e43d1ada4e728da7cc8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Creating volume 04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:01:28 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80a7492e-548e-4ef3-89ff-e2e0ce162dbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-213842e3-24d5-415a-acc4-bcd4d37f191c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:28 devstack sudo[85841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b 1073741824 Apr 13 11:01:28 devstack sudo[85841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5eef60-6a5a-4e5d-a512-9588c0ff78db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:28 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Volume volume-213842e3-24d5-415a-acc4-bcd4d37f191c (213842e3-24d5-415a-acc4-bcd4d37f191c): created successfully Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc5eef60-6a5a-4e5d-a512-9588c0ff78db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Flow 'volume_create_manager' (bd2c7837-87b1-4f31-8e82-5876e58d52d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:28 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b5ed412d-4404-488c-9410-45e76251bd79 tempest-VolumeQuotasNegativeTestJSON-312495102 None] Created volume successfully. Apr 13 11:01:28 devstack sudo[85838]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6.217c338b-7801-4258-adb4-ce5357276482" returned: 0 in 0.455s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-quobyte-217c338b-7801-4258-adb4-ce5357276482" released by "_delete_snapshot" :: held 2.170s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" released by "delete_snapshot" :: held 2.194s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Created reservations ['ec9f8a09-40e5-47e6-b098-35edcc1bfe1a', '9373a07b-29dc-4b55-ab96-b9be49d5ebce', '1cc95444-79e7-4f4a-8a6f-62ea1cc4f9e7', '1dc61c2e-8fa5-4f77-9b58-7c417ffbffad'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:28 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Delete snapshot completed successfully. Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7947117e-0c8e-4fee-9734-7cad6f4b7c8f tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-217c338b-7801-4258-adb4-ce5357276482-delete_snapshot" released by "delete_snapshot" :: held 2.297s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:28 devstack sudo[85841]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b 1073741824" returned: 0 in 0.501s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:28 devstack sudo[85847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:28 devstack sudo[85847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:29 devstack sudo[85847]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 0 in 0.419s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Attempting download of 22e76a71-372d-4748-bc00-afb5725ee06e ((None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}])) to volume 04ef4486-cc0f-41b3-930f-a79c722fec6b. {{(pid=82656) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9964ff66-f97a-413d-9545-0200305b9798]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_ywrffegu {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:29 devstack sudo[85850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_ywrffegu Apr 13 11:01:29 devstack sudo[85850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "cinder-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2350763b-b80d-4984-8957-a1135b787339]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:29 devstack sudo[85852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 Apr 13 11:01:29 devstack sudo[85852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:29 devstack sudo[85850]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_ywrffegu" returned: 0 in 0.532s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_ywrffegu {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:29 devstack sudo[85856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_ywrffegu Apr 13 11:01:29 devstack sudo[85856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Acquiring lock "cinder-213842e3-24d5-415a-acc4-bcd4d37f191c-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "cinder-213842e3-24d5-415a-acc4-bcd4d37f191c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Acquiring lock "cinder-quobyte-213842e3-24d5-415a-acc4-bcd4d37f191c" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "cinder-quobyte-213842e3-24d5-415a-acc4-bcd4d37f191c" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d69e80c-bdcd-469b-a32f-d7518fe372a1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:29 devstack sudo[85858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c Apr 13 11:01:29 devstack sudo[85858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:30 devstack sudo[85852]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" returned: 0 in 0.551s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:30 devstack sudo[85863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6 Apr 13 11:01:30 devstack sudo[85863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:30 devstack sudo[85856]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_ywrffegu" returned: 1 in 0.542s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_ywrffegu' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e841d2-3aeb-4146-bd08-bab6008b7365]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:30 devstack sudo[85868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD Apr 13 11:01:30 devstack sudo[85868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:30 devstack sudo[85858]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c" returned: 0 in 0.548s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:30 devstack sudo[85873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c Apr 13 11:01:30 devstack sudo[85873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:30 devstack sudo[85863]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" returned: 0 in 0.530s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-quobyte-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6" released by "delete_volume" :: held 1.126s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Created reservations ['07ebca5c-8769-45d7-b138-e12bbe870dfd', 'cd959052-5260-40bc-a2f0-f836f507a579', '5ed78a48-ab94-4ad5-88b0-d61e5ff25246', 'c6456c7c-c484-451b-8af7-32647f36b4b4'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:30 devstack sudo[85876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:30 devstack sudo[85876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:30 devstack sudo[85868]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD" returned: 0 in 0.610s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] 22e76a71-372d-4748-bc00-afb5725ee06e was qcow2, converting to raw {{(pid=82656) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:30 devstack sudo[85882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:30 devstack sudo[85882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:30 devstack sudo[85873]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-213842e3-24d5-415a-acc4-bcd4d37f191c" returned: 0 in 0.493s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "cinder-quobyte-213842e3-24d5-415a-acc4-bcd4d37f191c" released by "delete_volume" :: held 1.066s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:30 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Created reservations ['0cb1e076-0389-49ed-bd07-bd5ba367e9f1', 'b4d53ec8-815b-45bc-a43c-aad6f35faba4', 'fcaafd4f-349c-41f9-b945-8d3d5f078fba', '298d99b3-aa74-4464-bb9d-6dfc843d87b7'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:31 devstack sudo[85884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:31 devstack sudo[85884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:31 devstack sudo[85876]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.414s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:31 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Deleted volume successfully. Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dcb61b87-a936-463f-8908-d1894704df61 tempest-SnapshotsActionsTest-1020043812 None] Lock "cinder-e6579f5e-a175-4bc7-8aad-2bf8215c8aa6-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:31 devstack sudo[85884]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.532s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:31 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Deleted volume successfully. Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f9b3774b-5345-4b9d-a82b-ca12099faa9a tempest-VolumeQuotasNegativeTestJSON-312495102 None] Lock "cinder-213842e3-24d5-415a-acc4-bcd4d37f191c-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:31 devstack sudo[85882]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 0 in 1.071s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_ipx5qi63devstack@QuobyteHD, size 112.00 MB, duration 1.07 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:01:31 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Converted 112.00 MB image at 104.42 MB/s Apr 13 11:01:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:31 devstack sudo[85932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b 1G Apr 13 11:01:31 devstack sudo[85932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:32 devstack sudo[85932]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b 1G" returned: 0 in 0.517s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:32 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c47fd3-6eb5-4fcd-9012-85420d265698]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:32 devstack sudo[85938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:32 devstack sudo[85938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:33 devstack sudo[85938]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 0 in 0.597s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:33 devstack sudo[85943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:33 devstack sudo[85943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:33 devstack sudo[85943]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 1 in 0.687s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Downloaded image 22e76a71-372d-4748-bc00-afb5725ee06e ((None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}])) to volume 04ef4486-cc0f-41b3-930f-a79c722fec6b successfully. {{(pid=82656) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Temporary image 22e76a71-372d-4748-bc00-afb5725ee06e for user 32fbbbac2a2e43d1ada4e728da7cc8d0 is deleted. {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Marking volume 04ef4486-cc0f-41b3-930f-a79c722fec6b as bootable. {{(pid=82656) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Copying metadata from image 22e76a71-372d-4748-bc00-afb5725ee06e to 04ef4486-cc0f-41b3-930f-a79c722fec6b. {{(pid=82656) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Creating volume glance metadata for volume 04ef4486-cc0f-41b3-930f-a79c722fec6b backed by image 22e76a71-372d-4748-bc00-afb5725ee06e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82656) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (217dbd7c-3f19-4717-9aa3-2a156620ce8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04ef4486-cc0f-41b3-930f-a79c722fec6b', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386df59e-2bb1-4237-86e2-aed9e2d49c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:33 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Volume volume-04ef4486-cc0f-41b3-930f-a79c722fec6b (04ef4486-cc0f-41b3-930f-a79c722fec6b): created successfully Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386df59e-2bb1-4237-86e2-aed9e2d49c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Flow 'volume_create_manager' (dd19e7d1-37cb-4783-958f-40e33eb26a4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:33 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4f542a72-7ddc-4968-b01f-d19cf974df31 tempest-VolumesExtendTest-255357314 None] Created volume successfully. Apr 13 11:01:34 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-4ebf4cc1-30d5-466e-83fd-5224fd85c944 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Terminate volume connection completed successfully. Apr 13 11:01:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-4ebf4cc1-30d5-466e-83fd-5224fd85c944 tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Deleting attachment dcdf0391-b95b-4421-8de9-0f03d48a6260. {{(pid=82656) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "cinder-39f2d29e-2411-4040-a5c2-e4579143944e-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[718d2c9d-ab02-4cf7-9905-f3b26f375bd0]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "cinder-39f2d29e-2411-4040-a5c2-e4579143944e-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "cinder-quobyte-39f2d29e-2411-4040-a5c2-e4579143944e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "cinder-quobyte-39f2d29e-2411-4040-a5c2-e4579143944e" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[df59d8a9-ed84-4d30-8594-b26f596b4539]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:35 devstack sudo[85951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:35 devstack sudo[85951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:35 devstack sudo[85952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e Apr 13 11:01:35 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:35 devstack sudo[85951]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 0 in 0.682s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:35 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e" returned: 0 in 0.648s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:35 devstack sudo[85961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e Apr 13 11:01:35 devstack sudo[85961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:35 devstack sudo[85960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:35 devstack sudo[85960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Flow 'volume_create_manager' (2c1339cc-cd73-4805-add8-7ff6f317dc24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79aa5a0-4f39-4dd2-b31d-d40a51057ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f79aa5a0-4f39-4dd2-b31d-d40a51057ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-429733094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c485c7c4-649f-43fd-8782-eba9b3d699a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5549cff3f29446f4b8918ca40a5aac6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:36Z,use_quota=True,user_id='7f65cbf0bdbe4db69fb376dce678abf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dee59601-9f43-4e9a-ab7d-967c792e6148),volume_type_id=dee59601-9f43-4e9a-ab7d-967c792e6148)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3dc192-5106-422e-8707-5dc1a25f4e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f3dc192-5106-422e-8707-5dc1a25f4e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77f3fdd-53a1-43e5-a52d-f909f1dcfbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:36 devstack sudo[85961]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b77f3fdd-53a1-43e5-a52d-f909f1dcfbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c485c7c4-649f-43fd-8782-eba9b3d699a5', 'volume_name': 'volume-c485c7c4-649f-43fd-8782-eba9b3d699a5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c748e0d7-1c42-4c01-9a0b-ef89a8d7a484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c748e0d7-1c42-4c01-9a0b-ef89a8d7a484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b2c156-d6fa-430b-a647-030206f0a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:36 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Volume c485c7c4-649f-43fd-8782-eba9b3d699a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c485c7c4-649f-43fd-8782-eba9b3d699a5', 'volume_size': 1} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-39f2d29e-2411-4040-a5c2-e4579143944e" returned: 0 in 0.540s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "cinder-quobyte-39f2d29e-2411-4040-a5c2-e4579143944e" released by "delete_volume" :: held 1.217s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.quota [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Created reservations ['9686ef67-491c-43b0-a98e-1a2efd9d26b3', '2fb1aa59-003d-4aa7-b65a-212ca89d6635', 'b0f17159-bcd3-4cc4-bb2a-ae5a11e34bf7', 'de15cfc1-c5e3-4bc2-a7d9-79b3acb27f94'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:36 devstack sudo[85960]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 1 in 0.695s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b 2G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:36 devstack sudo[85968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:36 devstack sudo[85968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b 2G" returned: 0 in 0.036s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.473s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-429733094',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c485c7c4-649f-43fd-8782-eba9b3d699a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5549cff3f29446f4b8918ca40a5aac6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:36Z,use_quota=True,user_id='7f65cbf0bdbe4db69fb376dce678abf1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dee59601-9f43-4e9a-ab7d-967c792e6148),volume_type_id=dee59601-9f43-4e9a-ab7d-967c792e6148)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Creating volume c485c7c4-649f-43fd-8782-eba9b3d699a5 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:01:36 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:01:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:36 devstack sudo[85973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 1073741824 Apr 13 11:01:36 devstack sudo[85973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-85dc0c0f-631b-4c71-a604-3a89bfb363d0 tempest-VolumesExtendTest-255357314 None] Extend volume completed successfully. Apr 13 11:01:37 devstack sudo[85968]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.572s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.manager [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:37 devstack cinder-volume[82656]: INFO cinder.volume.manager [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Deleted volume successfully. Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [req-4cba9409-d6b1-4a7c-9a59-689f855ceb04 req-d8e1f90a-43e0-4cd6-985f-da0e318a491f tempest-ServerBootFromVolumeStableRescueTest-1303471084 None] Lock "cinder-39f2d29e-2411-4040-a5c2-e4579143944e-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:37 devstack sudo[85973]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 1073741824" returned: 0 in 0.564s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:37 devstack sudo[85979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 Apr 13 11:01:37 devstack sudo[85979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Acquiring lock "cinder-04ef4486-cc0f-41b3-930f-a79c722fec6b-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Lock "cinder-04ef4486-cc0f-41b3-930f-a79c722fec6b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Acquiring lock "cinder-quobyte-04ef4486-cc0f-41b3-930f-a79c722fec6b" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Lock "cinder-quobyte-04ef4486-cc0f-41b3-930f-a79c722fec6b" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e29e791-e419-4a8f-9efe-118bbcec2b32]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:37 devstack sudo[85979]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5" returned: 0 in 0.552s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] <== create_volume: return (1144ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.148s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:37 devstack sudo[86013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:37 devstack sudo[86013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51b2c156-d6fa-430b-a647-030206f0a890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c485c7c4-649f-43fd-8782-eba9b3d699a5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee4dbf2-bb3f-4d55-bda9-a44a57cdcf55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:37 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Volume volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 (c485c7c4-649f-43fd-8782-eba9b3d699a5): created successfully Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bee4dbf2-bb3f-4d55-bda9-a44a57cdcf55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Flow 'volume_create_manager' (2c1339cc-cd73-4805-add8-7ff6f317dc24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:37 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6e298d35-0ee6-409f-9690-ae1614eb322b tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Created volume successfully. Apr 13 11:01:38 devstack sudo[86013]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 0 in 0.649s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:38 devstack sudo[86020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:38 devstack sudo[86020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:38 devstack sudo[86026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:38 devstack sudo[86026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:38 devstack sudo[86020]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 1 in 0.651s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:01:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:38 devstack sudo[86028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:38 devstack sudo[86028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:38 devstack sudo[86029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b Apr 13 11:01:38 devstack sudo[86029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:39 devstack sudo[86026]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.541s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:39 devstack sudo[86029]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-04ef4486-cc0f-41b3-930f-a79c722fec6b" returned: 0 in 0.481s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Lock "cinder-quobyte-04ef4486-cc0f-41b3-930f-a79c722fec6b" released by "delete_volume" :: held 1.835s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Created reservations ['897338a0-6799-4539-83ac-e68951fc4b7e', 'b7aca6ad-2f22-487c-b7ba-4a79465c69a9', 'd80a03a4-aab6-4ec7-8a2a-1d3712d89097', 'b10847ba-b297-45a0-865b-c3318af8f6f1'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:39 devstack sudo[86028]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.560s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-72013b89-1cc0-4237-b36c-f5b9b2412364 tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Retype volume completed successfully. Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:39 devstack sudo[86035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:39 devstack sudo[86035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:01:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Flow 'volume_create_manager' (9be7f45b-91bf-4942-978e-ae907a75dcce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b56d976-89e3-445e-ac44-ebd69177300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b56d976-89e3-445e-ac44-ebd69177300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1272254898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b6c27b-2257-4422-a472-7f161c3faaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f5e827ad164073b186fd719bb0a7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:40Z,use_quota=True,user_id='32fbbbac2a2e43d1ada4e728da7cc8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95af0c5-3d09-461b-8327-0dd1e2e9fb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b95af0c5-3d09-461b-8327-0dd1e2e9fb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a948486-5941-44c1-82fe-d1927c27bfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a948486-5941-44c1-82fe-d1927c27bfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5b6c27b-2257-4422-a472-7f161c3faaf2', 'volume_name': 'volume-e5b6c27b-2257-4422-a472-7f161c3faaf2', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1b908b-03c5-41af-886e-366141ad96ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c1b908b-03c5-41af-886e-366141ad96ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8db52ac-e225-44b8-b7e7-493329934f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:40 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Volume e5b6c27b-2257-4422-a472-7f161c3faaf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5b6c27b-2257-4422-a472-7f161c3faaf2', 'volume_size': 1} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1272254898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5b6c27b-2257-4422-a472-7f161c3faaf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f5e827ad164073b186fd719bb0a7e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:40Z,use_quota=True,user_id='32fbbbac2a2e43d1ada4e728da7cc8d0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Creating volume e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:01:40 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:40 devstack sudo[86068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 1073741824 Apr 13 11:01:40 devstack sudo[86068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Acquiring lock "cinder-c485c7c4-649f-43fd-8782-eba9b3d699a5-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:40 devstack sudo[86035]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.768s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:40 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Deleted volume successfully. Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "cinder-c485c7c4-649f-43fd-8782-eba9b3d699a5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-956acfc9-8c64-414c-8bc8-46a179c221ca tempest-VolumesExtendTest-255357314 None] Lock "cinder-04ef4486-cc0f-41b3-930f-a79c722fec6b-delete_volume" released by "delete_volume" :: held 2.775s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Acquiring lock "cinder-quobyte-c485c7c4-649f-43fd-8782-eba9b3d699a5" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "cinder-quobyte-c485c7c4-649f-43fd-8782-eba9b3d699a5" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a58bf3a-d8ee-4e56-9ea2-b810fd23a955]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:40 devstack sudo[86070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 Apr 13 11:01:40 devstack sudo[86070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:40 devstack sudo[86068]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 1073741824" returned: 0 in 0.611s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:40 devstack sudo[86078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 Apr 13 11:01:40 devstack sudo[86078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:40 devstack sudo[86070]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5" returned: 0 in 0.610s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:40 devstack sudo[86081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5 Apr 13 11:01:40 devstack sudo[86081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:41 devstack sudo[86078]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2" returned: 0 in 0.573s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8db52ac-e225-44b8-b7e7-493329934f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5b6c27b-2257-4422-a472-7f161c3faaf2', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7081cb-f94d-4848-90e0-5c582c317903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:41 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Volume volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 (e5b6c27b-2257-4422-a472-7f161c3faaf2): created successfully Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7081cb-f94d-4848-90e0-5c582c317903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Flow 'volume_create_manager' (9be7f45b-91bf-4942-978e-ae907a75dcce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:41 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5fc15f26-8ccb-44f3-978b-a7c632a7424f tempest-VolumesExtendTest-255357314 None] Created volume successfully. Apr 13 11:01:41 devstack sudo[86081]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c485c7c4-649f-43fd-8782-eba9b3d699a5" returned: 0 in 0.605s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "cinder-quobyte-c485c7c4-649f-43fd-8782-eba9b3d699a5" released by "delete_volume" :: held 1.237s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:41 devstack cinder-volume[82656]: WARNING cinder.quota [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:01:41 devstack cinder-volume[82656]: WARNING cinder.quota [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Created reservations ['d8a13bc0-db9d-4199-9bf8-75c41597091b', '9176a155-30fb-456e-a91b-f78896486b67', '0fb9fe9d-6cdb-4ac5-aa72-744fd400f5c4', '5614808d-adaf-4c24-ada6-f44f374bd6e3'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:41 devstack sudo[86088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:41 devstack sudo[86088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:42 devstack sudo[86088]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.497s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:42 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Deleted volume successfully. Apr 13 11:01:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8c8c55ac-c24f-439c-a8e8-737ca0628ede tempest-VolumeRetypeWithoutMigrationTest-691076853 None] Lock "cinder-c485c7c4-649f-43fd-8782-eba9b3d699a5-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Creating offline snapshot d1751613-f13e-4560-a9b3-98ccd6355664 of volume e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:01:42 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c535a3-6788-43a7-835b-f55b254421bb]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:42 devstack sudo[86093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 Apr 13 11:01:42 devstack sudo[86093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:43 devstack sudo[86093]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2" returned: 0 in 0.686s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:43 devstack sudo[86098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 1G Apr 13 11:01:43 devstack sudo[86098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:43 devstack sudo[86098]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 1G" returned: 0 in 0.693s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:43 devstack sudo[86103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 Apr 13 11:01:43 devstack sudo[86103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:44 devstack sudo[86103]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664" returned: 0 in 0.564s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:44 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 is being set with open permissions: ugo+rw Apr 13 11:01:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:44 devstack sudo[86108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 Apr 13 11:01:44 devstack sudo[86108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:44 devstack sudo[86108]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664" returned: 0 in 0.519s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:44 devstack sudo[86111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.info Apr 13 11:01:44 devstack sudo[86111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:45 devstack sudo[86111]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.info" returned: 0 in 0.589s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:45 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.info is being set with open permissions: ugo+rw Apr 13 11:01:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:45 devstack sudo[86114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.info Apr 13 11:01:45 devstack sudo[86114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:46 devstack sudo[86114]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.info" returned: 0 in 0.592s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.730s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:46 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c0390b39-6e7b-4b09-ba70-3a638aa3698a tempest-VolumesExtendTest-255357314 None] Create snapshot completed successfully Apr 13 11:01:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4bab5097-e889-49f3-9a3e-124213a2fba2 tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4bab5097-e889-49f3-9a3e-124213a2fba2 tempest-VolumesExtendTest-255357314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:46 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7806dbe7-682d-49e9-af5b-2c42b26a5273]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bab5097-e889-49f3-9a3e-124213a2fba2 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:46 devstack sudo[86118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 Apr 13 11:01:46 devstack sudo[86118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:47 devstack sudo[86118]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bab5097-e889-49f3-9a3e-124213a2fba2 tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2" returned: 0 in 0.640s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bab5097-e889-49f3-9a3e-124213a2fba2 tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 2G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4bab5097-e889-49f3-9a3e-124213a2fba2 tempest-VolumesExtendTest-255357314 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 2G" returned: 0 in 0.103s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4bab5097-e889-49f3-9a3e-124213a2fba2 tempest-VolumesExtendTest-255357314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.762s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:47 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4bab5097-e889-49f3-9a3e-124213a2fba2 tempest-VolumesExtendTest-255357314 None] Extend volume completed successfully. Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Acquiring lock "cinder-d1751613-f13e-4560-a9b3-98ccd6355664-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Lock "cinder-d1751613-f13e-4560-a9b3-98ccd6355664-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Acquiring lock "cinder-quobyte-e5b6c27b-2257-4422-a472-7f161c3faaf2" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Lock "cinder-quobyte-e5b6c27b-2257-4422-a472-7f161c3faaf2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Acquiring lock "cinder-quobyte-d1751613-f13e-4560-a9b3-98ccd6355664" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Lock "cinder-quobyte-d1751613-f13e-4560-a9b3-98ccd6355664" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Deleting offline snapshot d1751613-f13e-4560-a9b3-98ccd6355664 of volume e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] snapshot_file for this snap is: volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0a2e5cd-608f-42c4-8de6-fe321f633c98]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:48 devstack sudo[86126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 Apr 13 11:01:48 devstack sudo[86126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:48 devstack sudo[86126]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664" returned: 0 in 0.603s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e5b6c27b-2257-4422-a472-7f161c3faaf2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:01:48 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c583ab-4d54-4beb-8755-93632c882ef5]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:48 devstack sudo[86131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 Apr 13 11:01:48 devstack sudo[86131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:49 devstack sudo[86131]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2" returned: 0 in 0.557s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:49 devstack sudo[86137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 Apr 13 11:01:49 devstack sudo[86137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:49 devstack sudo[86137]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664" returned: 0 in 0.531s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:49 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664 Apr 13 11:01:49 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:50 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2.d1751613-f13e-4560-a9b3-98ccd6355664" returned: 0 in 0.525s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Lock "cinder-quobyte-d1751613-f13e-4560-a9b3-98ccd6355664" released by "_delete_snapshot" :: held 2.300s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Lock "cinder-quobyte-e5b6c27b-2257-4422-a472-7f161c3faaf2" released by "delete_snapshot" :: held 2.310s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:50 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Created reservations ['4b7a78bd-bcea-4dfc-80cf-b1a47ed707d7', '5f2eb7b1-ea32-45d8-b7c2-0b33f14b27f1', 'd9ac5363-71a8-4a13-92ae-f8f5de0331db', '304c1a46-6905-4662-aa9e-34ef307ad19d'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:50 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Delete snapshot completed successfully. Apr 13 11:01:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3f6139bb-5060-44b2-9d74-dbb9ac58ad4b tempest-VolumesExtendTest-255357314 None] Lock "cinder-d1751613-f13e-4560-a9b3-98ccd6355664-delete_snapshot" released by "delete_snapshot" :: held 2.433s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Acquiring lock "cinder-e5b6c27b-2257-4422-a472-7f161c3faaf2-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Lock "cinder-e5b6c27b-2257-4422-a472-7f161c3faaf2-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Acquiring lock "cinder-quobyte-e5b6c27b-2257-4422-a472-7f161c3faaf2" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:01:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Lock "cinder-quobyte-e5b6c27b-2257-4422-a472-7f161c3faaf2" acquired by "delete_volume" :: waited 0.027s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:01:51 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfb41789-9e98-408a-8415-b476811bef6d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:51 devstack sudo[86145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 Apr 13 11:01:51 devstack sudo[86145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:52 devstack sudo[86145]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2" returned: 0 in 0.683s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:52 devstack sudo[86151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2 Apr 13 11:01:52 devstack sudo[86151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:52 devstack sudo[86151]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e5b6c27b-2257-4422-a472-7f161c3faaf2" returned: 0 in 0.640s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Lock "cinder-quobyte-e5b6c27b-2257-4422-a472-7f161c3faaf2" released by "delete_volume" :: held 1.371s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Created reservations ['2df267f4-6e44-4d7c-8803-fd8cf64aff90', '7c948344-4af2-465d-8262-c2e363f6a4e3', 'f86464ba-442c-44c6-804e-59bc1cdad2c5', '5a15fabc-677b-468f-bee9-991c9263039a'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:52 devstack sudo[86154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:01:52 devstack sudo[86154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Flow 'volume_create_manager' (f8b8d9a7-a4ba-4996-adc4-a2b8026d0d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f46cf3-e4f6-4dca-9f02-6f112279a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76f46cf3-e4f6-4dca-9f02-6f112279a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-996869431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5448b7af-0966-40d6-bd95-fe8d379a700e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4502505ad7f040b0b873b97ff12a27a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:53Z,use_quota=True,user_id='5a0796f382cd480096697e1da152201a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a81d19-b3d2-4a0f-8683-3c00346ccbd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32a81d19-b3d2-4a0f-8683-3c00346ccbd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def3ed2b-6ea5-4122-8bcf-0fe2bd2f487c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def3ed2b-6ea5-4122-8bcf-0fe2bd2f487c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5448b7af-0966-40d6-bd95-fe8d379a700e', 'volume_name': 'volume-5448b7af-0966-40d6-bd95-fe8d379a700e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08c7174-d239-4056-9b68-0c6dbf807ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f08c7174-d239-4056-9b68-0c6dbf807ed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814a03e5-ead1-4f03-bf2c-7c00cbf90174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:52 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Volume 5448b7af-0966-40d6-bd95-fe8d379a700e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5448b7af-0966-40d6-bd95-fe8d379a700e', 'volume_size': 1} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:01:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-996869431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5448b7af-0966-40d6-bd95-fe8d379a700e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4502505ad7f040b0b873b97ff12a27a5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:01:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:01:53Z,use_quota=True,user_id='5a0796f382cd480096697e1da152201a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Creating volume 5448b7af-0966-40d6-bd95-fe8d379a700e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:01:52 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:01:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:53 devstack sudo[86156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e 1073741824 Apr 13 11:01:53 devstack sudo[86156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:53 devstack sudo[86154]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.523s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:53 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:01:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Deleted volume successfully. Apr 13 11:01:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46892967-2b3f-43e4-b052-4481579b7d1e tempest-VolumesExtendTest-255357314 None] Lock "cinder-e5b6c27b-2257-4422-a472-7f161c3faaf2-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:01:53 devstack sudo[86156]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e 1073741824" returned: 0 in 0.798s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:53 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=139,cinder:SELECT=133,cinder:DELETE=13,cinder:INSERT=45 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:01:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:53 devstack sudo[86162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e Apr 13 11:01:53 devstack sudo[86162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:54 devstack sudo[86162]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e" returned: 0 in 0.577s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:01:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.410s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (814a03e5-ead1-4f03-bf2c-7c00cbf90174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5448b7af-0966-40d6-bd95-fe8d379a700e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2499bc-2a57-4686-ab60-608319553609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:01:54 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Volume volume-5448b7af-0966-40d6-bd95-fe8d379a700e (5448b7af-0966-40d6-bd95-fe8d379a700e): created successfully Apr 13 11:01:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2499bc-2a57-4686-ab60-608319553609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:01:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Flow 'volume_create_manager' (f8b8d9a7-a4ba-4996-adc4-a2b8026d0d47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:01:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1b269388-ee05-4e63-a9af-bd4bcacc80fe tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Created volume successfully. Apr 13 11:01:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:01:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:01:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Creating offline snapshot ecfe5014-47d5-40d1-b0ac-bcdb999553e4 of volume 5448b7af-0966-40d6-bd95-fe8d379a700e {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:01:55 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1074452-72c8-473c-af6e-39256ab34c96]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:01:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:55 devstack sudo[86165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e Apr 13 11:01:55 devstack sudo[86165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:55 devstack sudo[86165]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e" returned: 0 in 0.648s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:55 devstack sudo[86170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 1G Apr 13 11:01:55 devstack sudo[86170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:56 devstack sudo[86170]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 1G" returned: 0 in 0.847s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5448b7af-0966-40d6-bd95-fe8d379a700e -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:56 devstack sudo[86175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5448b7af-0966-40d6-bd95-fe8d379a700e -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 Apr 13 11:01:56 devstack sudo[86175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:57 devstack sudo[86175]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5448b7af-0966-40d6-bd95-fe8d379a700e -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4" returned: 0 in 0.596s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:57 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 is being set with open permissions: ugo+rw Apr 13 11:01:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:57 devstack sudo[86180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 Apr 13 11:01:57 devstack sudo[86180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:57 devstack sudo[86180]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4" returned: 0 in 0.623s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:57 devstack sudo[86183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.info Apr 13 11:01:57 devstack sudo[86183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:58 devstack sudo[86183]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.info" returned: 0 in 0.763s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:58 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.info is being set with open permissions: ugo+rw Apr 13 11:01:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:01:58 devstack sudo[86186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.info Apr 13 11:01:58 devstack sudo[86186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:01:59 devstack sudo[86186]: pam_unix(sudo:session): session closed for user root Apr 13 11:01:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.info" returned: 0 in 0.626s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:01:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.175s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:01:59 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-aa0e0022-d03c-41ce-bb7b-b75658106cf9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Create snapshot completed successfully Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "cinder-ecfe5014-47d5-40d1-b0ac-bcdb999553e4-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-ecfe5014-47d5-40d1-b0ac-bcdb999553e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "cinder-quobyte-5448b7af-0966-40d6-bd95-fe8d379a700e" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-quobyte-5448b7af-0966-40d6-bd95-fe8d379a700e" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "cinder-quobyte-ecfe5014-47d5-40d1-b0ac-bcdb999553e4" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-quobyte-ecfe5014-47d5-40d1-b0ac-bcdb999553e4" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Deleting offline snapshot ecfe5014-47d5-40d1-b0ac-bcdb999553e4 of volume 5448b7af-0966-40d6-bd95-fe8d379a700e {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] snapshot_file for this snap is: volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a36bd06-cafa-4a3b-bb7c-3bc1b45912c5]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:00 devstack sudo[86189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 Apr 13 11:02:00 devstack sudo[86189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:01 devstack sudo[86189]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4" returned: 0 in 0.622s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5448b7af-0966-40d6-bd95-fe8d379a700e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:02:01 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0b9e92f-9ac5-49dd-a3a2-4543fd38b7a8]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:01 devstack sudo[86194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e Apr 13 11:02:01 devstack sudo[86194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:02 devstack sudo[86194]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e" returned: 0 in 0.629s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:02 devstack sudo[86200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 Apr 13 11:02:02 devstack sudo[86200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:02 devstack sudo[86200]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4" returned: 0 in 0.828s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:02 devstack sudo[86205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4 Apr 13 11:02:02 devstack sudo[86205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:03 devstack sudo[86205]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e.ecfe5014-47d5-40d1-b0ac-bcdb999553e4" returned: 0 in 0.698s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-quobyte-ecfe5014-47d5-40d1-b0ac-bcdb999553e4" released by "_delete_snapshot" :: held 2.857s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-quobyte-5448b7af-0966-40d6-bd95-fe8d379a700e" released by "delete_snapshot" :: held 2.874s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:INSERT=37,cinder:SELECT=127,cinder:UPDATE=151,cinder:DELETE=9 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Created reservations ['1f2819ea-935c-4ab7-8def-7a71b53a7e8a', '193d199c-63d1-4a96-83bf-d2af7cf323a7', '51fcafbf-80a1-4bc6-8a29-d4aaccda5813', '17f407fc-407c-4e9a-8dcf-9aad012fdb1c'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Delete snapshot completed successfully. Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-15b24404-0b61-4332-b9ea-ab5e6d565e54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-ecfe5014-47d5-40d1-b0ac-bcdb999553e4-delete_snapshot" released by "delete_snapshot" :: held 2.989s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Flow 'volume_create_manager' (0769a937-6618-4be1-adcc-3459ab613b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cccc69-d6b9-4ec8-93e6-1e698f4e6422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3cccc69-d6b9-4ec8-93e6-1e698f4e6422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1634514197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c1e268-636d-4987-839b-4eeaf8b5363d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90d8be887b08435caea25ef94b82a658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:04Z,use_quota=True,user_id='d9afa9eb732143b09f14b463344becad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ce32a8-6192-4d51-a985-6f9867a6af37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47ce32a8-6192-4d51-a985-6f9867a6af37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614ebd40-026a-4c25-af5d-35cbb56d77fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614ebd40-026a-4c25-af5d-35cbb56d77fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3c1e268-636d-4987-839b-4eeaf8b5363d', 'volume_name': 'volume-d3c1e268-636d-4987-839b-4eeaf8b5363d', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3fb5c4-daaa-4656-8f54-2bfc7d442c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c3fb5c4-daaa-4656-8f54-2bfc7d442c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da232bf2-c200-4385-965c-cd8eb73371d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:03 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Volume d3c1e268-636d-4987-839b-4eeaf8b5363d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3c1e268-636d-4987-839b-4eeaf8b5363d', 'volume_size': 1} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1634514197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3c1e268-636d-4987-839b-4eeaf8b5363d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90d8be887b08435caea25ef94b82a658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:04Z,use_quota=True,user_id='d9afa9eb732143b09f14b463344becad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Creating volume d3c1e268-636d-4987-839b-4eeaf8b5363d {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:03 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:03 devstack sudo[86212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d 1073741824 Apr 13 11:02:03 devstack sudo[86212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "cinder-5448b7af-0966-40d6-bd95-fe8d379a700e-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-5448b7af-0966-40d6-bd95-fe8d379a700e-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "cinder-quobyte-5448b7af-0966-40d6-bd95-fe8d379a700e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-quobyte-5448b7af-0966-40d6-bd95-fe8d379a700e" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d90698ee-a6f7-423d-af99-170e6af93734]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:04 devstack sudo[86215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e Apr 13 11:02:04 devstack sudo[86215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:04 devstack sudo[86212]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d 1073741824" returned: 0 in 0.684s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:04 devstack sudo[86226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d Apr 13 11:02:04 devstack sudo[86226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:04 devstack sudo[86215]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e" returned: 0 in 0.651s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:04 devstack sudo[86229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e Apr 13 11:02:04 devstack sudo[86229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:05 devstack sudo[86226]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d" returned: 0 in 0.547s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] <== create_volume: return (1286ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.289s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da232bf2-c200-4385-965c-cd8eb73371d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3c1e268-636d-4987-839b-4eeaf8b5363d', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad8090f-ddd4-4289-97ed-3e5f85320ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:05 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Volume volume-d3c1e268-636d-4987-839b-4eeaf8b5363d (d3c1e268-636d-4987-839b-4eeaf8b5363d): created successfully Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ad8090f-ddd4-4289-97ed-3e5f85320ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Flow 'volume_create_manager' (0769a937-6618-4be1-adcc-3459ab613b27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-484e9f8a-75b4-4b37-97e7-5f034082fa74 tempest-VolumesListTestJSON-1083884574 None] Created volume successfully. Apr 13 11:02:05 devstack sudo[86229]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5448b7af-0966-40d6-bd95-fe8d379a700e" returned: 0 in 0.592s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-quobyte-5448b7af-0966-40d6-bd95-fe8d379a700e" released by "delete_volume" :: held 1.288s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Created reservations ['aafaebf9-53af-462a-9202-1183f4ba17b3', '973e9075-82cf-486e-8c85-dc3c4b2aa840', '44672d4f-7fe4-4ead-8b5e-c47277573232', '7a242d9e-a3e0-4bc0-a755-3fc4a2c5bb96'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:05 devstack sudo[86237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:05 devstack sudo[86237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:05 devstack sudo[86237]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.491s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:05 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Deleted volume successfully. Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ba06747a-8068-4e99-bb2a-7c073c467d7b tempest-VolumeSnapshotQuotasNegativeTestJSON-1880454252 None] Lock "cinder-5448b7af-0966-40d6-bd95-fe8d379a700e-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Flow 'volume_create_manager' (22034b6a-d8fe-42f6-bc10-fffefcb18682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b34e39-9215-4afd-9736-6c174e88f036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b34e39-9215-4afd-9736-6c174e88f036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2048003512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a306c6c-93ad-4695-8ed6-d8651478ff92,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90d8be887b08435caea25ef94b82a658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:06Z,use_quota=True,user_id='d9afa9eb732143b09f14b463344becad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167b0927-3eda-4c36-a17a-31441848b4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167b0927-3eda-4c36-a17a-31441848b4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa359c9f-2f4f-4107-9210-2302af9f5b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa359c9f-2f4f-4107-9210-2302af9f5b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a306c6c-93ad-4695-8ed6-d8651478ff92', 'volume_name': 'volume-9a306c6c-93ad-4695-8ed6-d8651478ff92', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e53040b-ba5c-490b-a8a5-921e554efb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e53040b-ba5c-490b-a8a5-921e554efb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115ae90a-c6ca-4d98-82e8-a3cc6dc5f265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Volume 9a306c6c-93ad-4695-8ed6-d8651478ff92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a306c6c-93ad-4695-8ed6-d8651478ff92', 'volume_size': 1} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-2048003512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a306c6c-93ad-4695-8ed6-d8651478ff92,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90d8be887b08435caea25ef94b82a658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:06Z,use_quota=True,user_id='d9afa9eb732143b09f14b463344becad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Creating volume 9a306c6c-93ad-4695-8ed6-d8651478ff92 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:06 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:06 devstack sudo[86241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 1073741824 Apr 13 11:02:06 devstack sudo[86241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:06 devstack sudo[86241]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 1073741824" returned: 0 in 0.596s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:07 devstack sudo[86246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 Apr 13 11:02:07 devstack sudo[86246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:07 devstack sudo[86246]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (115ae90a-c6ca-4d98-82e8-a3cc6dc5f265) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a306c6c-93ad-4695-8ed6-d8651478ff92', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413f8816-6cce-46c4-984e-9bff64082192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:07 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Volume volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 (9a306c6c-93ad-4695-8ed6-d8651478ff92): created successfully Apr 13 11:02:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (413f8816-6cce-46c4-984e-9bff64082192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Flow 'volume_create_manager' (22034b6a-d8fe-42f6-bc10-fffefcb18682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:07 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-56ce87f2-ac46-45fb-923b-d3be49b7dc0c tempest-VolumesListTestJSON-1083884574 None] Created volume successfully. Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Flow 'volume_create_manager' (645eca8a-716d-44aa-819a-1ffa8eb1cccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91afd75a-3cd1-4d8d-8d4d-ccb68468523b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91afd75a-3cd1-4d8d-8d4d-ccb68468523b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1543461797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6037f605-45a9-4ee2-9bee-488acac9d174,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90d8be887b08435caea25ef94b82a658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:09Z,use_quota=True,user_id='d9afa9eb732143b09f14b463344becad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3631461-a1a9-41da-9732-c750c9850144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3631461-a1a9-41da-9732-c750c9850144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3496d487-3ed6-4b05-b41f-8bf4384e5ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3496d487-3ed6-4b05-b41f-8bf4384e5ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6037f605-45a9-4ee2-9bee-488acac9d174', 'volume_name': 'volume-6037f605-45a9-4ee2-9bee-488acac9d174', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd64c67f-c9d7-4391-8da7-b698d9317003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd64c67f-c9d7-4391-8da7-b698d9317003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c3d56f-ef75-4e1a-8ece-c646d62762e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:08 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Volume 6037f605-45a9-4ee2-9bee-488acac9d174: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6037f605-45a9-4ee2-9bee-488acac9d174', 'volume_size': 1} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1543461797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6037f605-45a9-4ee2-9bee-488acac9d174,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='90d8be887b08435caea25ef94b82a658',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:09Z,use_quota=True,user_id='d9afa9eb732143b09f14b463344becad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Creating volume 6037f605-45a9-4ee2-9bee-488acac9d174 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:08 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:08 devstack sudo[86249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 1073741824 Apr 13 11:02:08 devstack sudo[86249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:09 devstack sudo[86249]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 1073741824" returned: 0 in 0.738s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:09 devstack sudo[86257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 Apr 13 11:02:09 devstack sudo[86257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:10 devstack sudo[86257]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174" returned: 0 in 0.497s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.264s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3c3d56f-ef75-4e1a-8ece-c646d62762e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6037f605-45a9-4ee2-9bee-488acac9d174', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc6a76a-93a4-42b1-aebc-db46a4b23517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:10 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Volume volume-6037f605-45a9-4ee2-9bee-488acac9d174 (6037f605-45a9-4ee2-9bee-488acac9d174): created successfully Apr 13 11:02:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc6a76a-93a4-42b1-aebc-db46a4b23517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Flow 'volume_create_manager' (645eca8a-716d-44aa-819a-1ffa8eb1cccd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:10 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-196db7af-8d7f-4a1e-b5e7-ccbf86af084e tempest-VolumesListTestJSON-1083884574 None] Created volume successfully. Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Flow 'volume_create_manager' (cd5f475b-486f-4e66-b883-f8f6ce7eb232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4a89a2-f521-47a8-b2e2-99256e681e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e4a89a2-f521-47a8-b2e2-99256e681e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-27190788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30602d3a-d40d-48c9-a65a-cb7f23b1276e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c72375aa1f7465eaf27679de5354c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:12Z,use_quota=True,user_id='04844d16e4bd48c29438957c26e30a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470b390c-fdda-445d-a1b2-21d269010089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (470b390c-fdda-445d-a1b2-21d269010089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639a9e68-dcb7-44dd-b9c5-aa80283593ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.image.glance [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Creating Keystone auth plugin from conf {{(pid=82656) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (639a9e68-dcb7-44dd-b9c5-aa80283593ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '30602d3a-d40d-48c9-a65a-cb7f23b1276e', 'volume_name': 'volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbff5eb-326f-4b55-8c88-d3cc8db943af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fbff5eb-326f-4b55-8c88-d3cc8db943af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ee8ebc-bb00-4f5f-88e3-5dea5fa3b0df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:12 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Volume 30602d3a-d40d-48c9-a65a-cb7f23b1276e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Trying to clone 30602d3a-d40d-48c9-a65a-cb7f23b1276e from image 22e76a71-372d-4748-bc00-afb5725ee06e at location (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]). {{(pid=82656) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 11:02:12 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Image download 20.69 MB at 20.69 MB/s Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc74e75f-1fb5-41b7-9a1b-a14b85739450]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:12 devstack sudo[86295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD Apr 13 11:02:12 devstack sudo[86295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:13 devstack sudo[86295]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD" returned: 0 in 0.675s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Temporary image 22e76a71-372d-4748-bc00-afb5725ee06e is fetched for user 04844d16e4bd48c29438957c26e30a4d. {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[374e2a30-5abd-4284-8562-43edad8e061f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:13 devstack sudo[86303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD Apr 13 11:02:13 devstack sudo[86303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "cinder-6037f605-45a9-4ee2-9bee-488acac9d174-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-6037f605-45a9-4ee2-9bee-488acac9d174-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "cinder-quobyte-6037f605-45a9-4ee2-9bee-488acac9d174" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-quobyte-6037f605-45a9-4ee2-9bee-488acac9d174" acquired by "delete_volume" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaef94c-2451-4cda-b540-00c6f464c80b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:14 devstack sudo[86305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 Apr 13 11:02:14 devstack sudo[86305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:14 devstack sudo[86303]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-27190788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30602d3a-d40d-48c9-a65a-cb7f23b1276e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5c72375aa1f7465eaf27679de5354c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:12Z,use_quota=True,user_id='04844d16e4bd48c29438957c26e30a4d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Creating volume 30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:14 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:14 devstack sudo[86313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e 1073741824 Apr 13 11:02:14 devstack sudo[86313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:14 devstack sudo[86305]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174" returned: 0 in 0.787s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:14 devstack sudo[86330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174 Apr 13 11:02:14 devstack sudo[86330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:15 devstack sudo[86313]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e 1073741824" returned: 0 in 0.934s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:15 devstack sudo[86363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e Apr 13 11:02:15 devstack sudo[86363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:15 devstack sudo[86330]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6037f605-45a9-4ee2-9bee-488acac9d174" returned: 0 in 0.849s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-quobyte-6037f605-45a9-4ee2-9bee-488acac9d174" released by "delete_volume" :: held 1.675s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Created reservations ['4247cc30-0eb6-4a6f-8984-a6282f2672f3', 'ee415952-28ee-47e0-abb7-54331f9009b4', '827a97a0-b635-4ca5-8e11-c4847ad916de', '9aaa2d49-3bc9-4173-9b3d-59df11c72938'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:15 devstack sudo[86370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:15 devstack sudo[86370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:15 devstack sudo[86363]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e" returned: 0 in 0.608s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Attempting download of 22e76a71-372d-4748-bc00-afb5725ee06e ((None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}])) to volume 30602d3a-d40d-48c9-a65a-cb7f23b1276e. {{(pid=82656) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5becd9c-c726-453d-8534-8f2f52f9a9c3]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_7vduuqva {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:15 devstack sudo[86374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_7vduuqva Apr 13 11:02:15 devstack sudo[86374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "cinder-9a306c6c-93ad-4695-8ed6-d8651478ff92-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-9a306c6c-93ad-4695-8ed6-d8651478ff92-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:16 devstack sudo[86370]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.542s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Deleted volume successfully. Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "cinder-quobyte-9a306c6c-93ad-4695-8ed6-d8651478ff92" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2aa0c3cc-d7e5-46f2-b3b6-ef94783c368f tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-6037f605-45a9-4ee2-9bee-488acac9d174-delete_volume" released by "delete_volume" :: held 2.395s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-quobyte-9a306c6c-93ad-4695-8ed6-d8651478ff92" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdb5bb0-285b-4602-96d6-6a2e1c713808]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:16 devstack sudo[86377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 Apr 13 11:02:16 devstack sudo[86377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:16 devstack sudo[86374]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_7vduuqva" returned: 0 in 0.643s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_7vduuqva {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:16 devstack sudo[86383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_7vduuqva Apr 13 11:02:16 devstack sudo[86383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:16 devstack sudo[86377]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92" returned: 0 in 0.575s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:16 devstack sudo[86391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92 Apr 13 11:02:16 devstack sudo[86391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:17 devstack sudo[86383]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_7vduuqva" returned: 1 in 0.667s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_7vduuqva' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:02:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bdd915-2516-4277-b172-fe6267fbc62d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:17 devstack sudo[86415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD Apr 13 11:02:17 devstack sudo[86415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:17 devstack sudo[86391]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9a306c6c-93ad-4695-8ed6-d8651478ff92" returned: 0 in 1.048s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-quobyte-9a306c6c-93ad-4695-8ed6-d8651478ff92" released by "delete_volume" :: held 1.681s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:17 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Created reservations ['a8885703-e7b5-49a4-9da8-65652f8e668d', 'd91ecaf2-19ec-4fdc-9085-832fecb9a3e0', '6b83bf4d-83b9-434e-a716-e8fa43b030d1', 'd7f236b5-0a37-418f-bf79-13dd4b571897'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:18 devstack sudo[86424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:18 devstack sudo[86424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:18 devstack sudo[86415]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD" returned: 0 in 1.000s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] 22e76a71-372d-4748-bc00-afb5725ee06e was qcow2, converting to raw {{(pid=82656) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:18 devstack sudo[86429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e Apr 13 11:02:18 devstack sudo[86429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "cinder-d3c1e268-636d-4987-839b-4eeaf8b5363d-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:18 devstack sudo[86424]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-d3c1e268-636d-4987-839b-4eeaf8b5363d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.566s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Deleted volume successfully. Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "cinder-quobyte-d3c1e268-636d-4987-839b-4eeaf8b5363d" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ff4567e1-5fe5-4259-83cf-4531711d8300 tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-9a306c6c-93ad-4695-8ed6-d8651478ff92-delete_volume" released by "delete_volume" :: held 2.620s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-quobyte-d3c1e268-636d-4987-839b-4eeaf8b5363d" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9219ddb2-145a-4d0b-8d51-08f87a2a1b39]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:18 devstack sudo[86436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d Apr 13 11:02:18 devstack sudo[86436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:19 devstack sudo[86429]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e" returned: 0 in 1.757s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:19 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_a9gdselbdevstack@QuobyteHD, size 112.00 MB, duration 1.76 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:02:19 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Converted 112.00 MB image at 63.68 MB/s Apr 13 11:02:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:19 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:19 devstack sudo[86472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e 1G Apr 13 11:02:19 devstack sudo[86472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (d21e7813-e811-4fe3-b4ab-49739c46c3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ade6169-38a3-4b21-9dbf-f53d3517bf42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ade6169-38a3-4b21-9dbf-f53d3517bf42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1978771727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6625e5f-747b-43ce-9a8b-52a90b6f3ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:20Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77266ddb-a2dd-4ed6-b114-16585be715e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77266ddb-a2dd-4ed6-b114-16585be715e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727d6f32-3cde-42bf-af35-3890a5707cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727d6f32-3cde-42bf-af35-3890a5707cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6625e5f-747b-43ce-9a8b-52a90b6f3ab8', 'volume_name': 'volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bb38bf-ac04-4a43-b6e9-00124be6a946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21bb38bf-ac04-4a43-b6e9-00124be6a946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f049f0a6-8edd-4c2d-86e4-1a9af15ca782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:20 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Volume e6625e5f-747b-43ce-9a8b-52a90b6f3ab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8', 'volume_size': 1} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1978771727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6625e5f-747b-43ce-9a8b-52a90b6f3ab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:20Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Creating volume e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:20 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:20 devstack sudo[86475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 1073741824 Apr 13 11:02:20 devstack sudo[86475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:20 devstack sudo[86436]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d" returned: 0 in 1.680s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:20 devstack sudo[86481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d Apr 13 11:02:20 devstack sudo[86481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:20 devstack sudo[86472]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e 1G" returned: 0 in 0.901s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f235601-bd24-4c55-9935-05c0a2e42684]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:21 devstack sudo[86487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e Apr 13 11:02:21 devstack sudo[86487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:21 devstack sudo[86475]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 1073741824" returned: 0 in 1.265s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:21 devstack sudo[86481]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d3c1e268-636d-4987-839b-4eeaf8b5363d" returned: 0 in 0.964s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-quobyte-d3c1e268-636d-4987-839b-4eeaf8b5363d" released by "delete_volume" :: held 2.719s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:21 devstack sudo[86499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 Apr 13 11:02:21 devstack sudo[86499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Created reservations ['d123c097-8706-4726-ac35-15c10f0d7e47', '31d66ba9-2a8d-4c31-9a9a-c8c5e99ab241', '8bc711fc-b357-481c-8dcd-a16e7876518e', '11f8f747-8bd1-4b9c-93a3-ac1067261221'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:21 devstack sudo[86501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:21 devstack sudo[86501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:22 devstack sudo[86487]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e" returned: 0 in 1.210s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:22 devstack sudo[86507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e Apr 13 11:02:22 devstack sudo[86507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:22 devstack sudo[86501]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.808s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:22 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Deleted volume successfully. Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-05b14ae5-c4f7-44d8-928a-3c4b5de6ec9f tempest-VolumesListTestJSON-1083884574 None] Lock "cinder-d3c1e268-636d-4987-839b-4eeaf8b5363d-delete_volume" released by "delete_volume" :: held 3.875s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:22 devstack sudo[86499]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" returned: 0 in 1.091s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] <== create_volume: return (2424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.430s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f049f0a6-8edd-4c2d-86e4-1a9af15ca782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caab3de0-2274-4161-b6f3-57f986a53a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:22 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Volume volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 (e6625e5f-747b-43ce-9a8b-52a90b6f3ab8): created successfully Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caab3de0-2274-4161-b6f3-57f986a53a6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (d21e7813-e811-4fe3-b4ab-49739c46c3ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:22 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-71b7e5dc-b0f5-4192-9a6a-a6a4aebf6346 tempest-VolumesActionsTest-1635315142 None] Created volume successfully. Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3838149-4b80-4a3d-b876-1f7ab2a246a8 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" by "attach_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3838149-4b80-4a3d-b876-1f7ab2a246a8 tempest-VolumesActionsTest-1635315142 None] Lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" acquired by "attach_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d3838149-4b80-4a3d-b876-1f7ab2a246a8 tempest-VolumesActionsTest-1635315142 None] Attaching volume e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 to instance 61f0a3f0-ad90-413c-b34f-07201574bd7f at mountpoint /dev/vdb on host None. Apr 13 11:02:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d3838149-4b80-4a3d-b876-1f7ab2a246a8 tempest-VolumesActionsTest-1635315142 None] Attach volume completed successfully. Apr 13 11:02:23 devstack sudo[86507]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e" returned: 1 in 1.287s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Downloaded image 22e76a71-372d-4748-bc00-afb5725ee06e ((None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}])) to volume 30602d3a-d40d-48c9-a65a-cb7f23b1276e successfully. {{(pid=82656) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Temporary image 22e76a71-372d-4748-bc00-afb5725ee06e for user 04844d16e4bd48c29438957c26e30a4d is deleted. {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Marking volume 30602d3a-d40d-48c9-a65a-cb7f23b1276e as bootable. {{(pid=82656) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3838149-4b80-4a3d-b876-1f7ab2a246a8 tempest-VolumesActionsTest-1635315142 None] Lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" released by "attach_volume" :: held 0.226s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Copying metadata from image 22e76a71-372d-4748-bc00-afb5725ee06e to 30602d3a-d40d-48c9-a65a-cb7f23b1276e. {{(pid=82656) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Creating volume glance metadata for volume 30602d3a-d40d-48c9-a65a-cb7f23b1276e backed by image 22e76a71-372d-4748-bc00-afb5725ee06e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82656) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41ee8ebc-bb00-4f5f-88e3-5dea5fa3b0df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516327f8-c8ab-45d0-8633-34dd6530723a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:23 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Volume volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e (30602d3a-d40d-48c9-a65a-cb7f23b1276e): created successfully Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (516327f8-c8ab-45d0-8633-34dd6530723a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Flow 'volume_create_manager' (cd5f475b-486f-4e66-b883-f8f6ce7eb232) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-103d741d-5e6c-43cb-bf37-b6f79b320ce0 tempest-VolumesImageMetadata-1495718112 None] Created volume successfully. Apr 13 11:02:24 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-aa7f431d-d92b-4f97-adf2-37dbe49f0579 tempest-VolumesActionsTest-479573529 None] Terminate volume connection completed successfully. Apr 13 11:02:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Acquiring lock "cinder-30602d3a-d40d-48c9-a65a-cb7f23b1276e-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Lock "cinder-30602d3a-d40d-48c9-a65a-cb7f23b1276e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Acquiring lock "cinder-quobyte-30602d3a-d40d-48c9-a65a-cb7f23b1276e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Lock "cinder-quobyte-30602d3a-d40d-48c9-a65a-cb7f23b1276e" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:25 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2180e29d-fa94-40ef-988c-f024c70eb025]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:25 devstack sudo[86515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e Apr 13 11:02:25 devstack sudo[86515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa7f431d-d92b-4f97-adf2-37dbe49f0579 tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-detach_volume" by "detach_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa7f431d-d92b-4f97-adf2-37dbe49f0579 tempest-VolumesActionsTest-479573529 None] Lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:25 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-aa7f431d-d92b-4f97-adf2-37dbe49f0579 tempest-VolumesActionsTest-479573529 None] Detaching volume e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 from instance 61f0a3f0-ad90-413c-b34f-07201574bd7f. Apr 13 11:02:25 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-aa7f431d-d92b-4f97-adf2-37dbe49f0579 tempest-VolumesActionsTest-479573529 None] Detach volume completed successfully. Apr 13 11:02:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa7f431d-d92b-4f97-adf2-37dbe49f0579 tempest-VolumesActionsTest-479573529 None] Lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-detach_volume" released by "detach_volume" :: held 0.097s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:26 devstack sudo[86515]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e" returned: 0 in 0.908s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a1baa0d1-9d4a-4efc-bf43-f6feb91dbb88 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-detach_volume" by "detach_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a1baa0d1-9d4a-4efc-bf43-f6feb91dbb88 tempest-VolumesActionsTest-1635315142 None] Lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-detach_volume" acquired by "detach_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:26 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-a1baa0d1-9d4a-4efc-bf43-f6feb91dbb88 tempest-VolumesActionsTest-1635315142 None] Volume detach called, but volume not attached. Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a1baa0d1-9d4a-4efc-bf43-f6feb91dbb88 tempest-VolumesActionsTest-1635315142 None] Lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-detach_volume" released by "detach_volume" :: held 0.041s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:26 devstack sudo[86519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e Apr 13 11:02:26 devstack sudo[86519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Flow 'volume_create_manager' (1748f2bd-9cce-4976-a5a8-cef13cd9ce97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036c7ea5-7acd-430e-8817-e6bc7776d0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (036c7ea5-7acd-430e-8817-e6bc7776d0c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1181833481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69fcdcd-5a93-4d60-ae71-4318bbada9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ddd15fd4315402e96aee5075ec31e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:26Z,use_quota=True,user_id='1181311647144452afdceeb7825a388f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8612cce-6190-43e5-bcae-c8413a543466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8612cce-6190-43e5-bcae-c8413a543466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b47866-f57e-44ad-93f7-bf03c943d24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5b47866-f57e-44ad-93f7-bf03c943d24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e69fcdcd-5a93-4d60-ae71-4318bbada9af', 'volume_name': 'volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275df1a6-6a83-437c-934f-f1bfb114c071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (275df1a6-6a83-437c-934f-f1bfb114c071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60769ce8-7bd5-4eef-b15d-ec48a82b5aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:26 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Volume e69fcdcd-5a93-4d60-ae71-4318bbada9af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af', 'volume_size': 1} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1181833481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69fcdcd-5a93-4d60-ae71-4318bbada9af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ddd15fd4315402e96aee5075ec31e54',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:26Z,use_quota=True,user_id='1181311647144452afdceeb7825a388f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Creating volume e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:26 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:26 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af 1073741824 Apr 13 11:02:26 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:27 devstack sudo[86519]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Acquiring lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e" returned: 1 in 1.022s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:27 devstack sudo[86550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e Apr 13 11:02:27 devstack sudo[86550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Acquiring lock "cinder-quobyte-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Lock "cinder-quobyte-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0afa7f34-bec0-4943-8499-82600b14e677]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:27 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af 1073741824" returned: 0 in 0.988s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:27 devstack sudo[86554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af Apr 13 11:02:27 devstack sudo[86554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:27 devstack sudo[86553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 Apr 13 11:02:27 devstack sudo[86553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:28 devstack sudo[86550]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-30602d3a-d40d-48c9-a65a-cb7f23b1276e" returned: 0 in 0.896s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Lock "cinder-quobyte-30602d3a-d40d-48c9-a65a-cb7f23b1276e" released by "delete_volume" :: held 2.964s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Created reservations ['131e90c6-c8c2-424f-b32b-697c99d392a5', '82ddc30e-5aa7-4aae-81fe-244fe3c4045c', 'be00196f-1aec-4901-b7b7-28ec6284324c', '5e9265eb-e7ae-43de-9ee2-4e124c81bd76'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:28 devstack sudo[86559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:28 devstack sudo[86559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:29 devstack sudo[86553]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" returned: 0 in 1.716s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:29 devstack sudo[86554]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af" returned: 0 in 1.506s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] <== create_volume: return (2556ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.560s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60769ce8-7bd5-4eef-b15d-ec48a82b5aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:29 devstack sudo[86571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8 Apr 13 11:02:29 devstack sudo[86571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26ec03a-9f6f-483e-ba6a-b60535ceb484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:29 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Volume volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af (e69fcdcd-5a93-4d60-ae71-4318bbada9af): created successfully Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c26ec03a-9f6f-483e-ba6a-b60535ceb484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Flow 'volume_create_manager' (1748f2bd-9cce-4976-a5a8-cef13cd9ce97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:29 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2208550f-3011-4a33-82eb-a0214c19f1fb tempest-VolumesSnapshotListTestJSON-906848224 None] Created volume successfully. Apr 13 11:02:29 devstack sudo[86559]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.115s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:29 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Deleted volume successfully. Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d99cf481-8280-4809-8e74-6e708a6114cd tempest-VolumesImageMetadata-1495718112 None] Lock "cinder-30602d3a-d40d-48c9-a65a-cb7f23b1276e-delete_volume" released by "delete_volume" :: held 4.390s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:29 devstack sudo[86571]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" returned: 0 in 0.806s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Lock "cinder-quobyte-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8" released by "delete_volume" :: held 2.567s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:29 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Created reservations ['c53b66c5-be04-47b4-af14-151ea5908a0b', 'a9eb8e6b-0edc-42ba-ae44-3c0253f9ce09', 'b63e48ea-fed3-4501-95a0-f4ac7ae84e46', '382a93e5-326b-4b93-8741-5e5b50df8a3b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:30 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:30 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Creating offline snapshot f5a2c508-84d5-4ca5-8e34-f7c78fefe655 of volume e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8768d32-d119-4318-9154-4f01acb1705e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:30 devstack sudo[86578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af Apr 13 11:02:30 devstack sudo[86578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:31 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.189s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:31 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:31 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Deleted volume successfully. Apr 13 11:02:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-13f4b0da-40ba-44d4-8cf0-05c12b20c30f tempest-VolumesActionsTest-1635315142 None] Lock "cinder-e6625e5f-747b-43ce-9a8b-52a90b6f3ab8-delete_volume" released by "delete_volume" :: held 4.141s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:31 devstack sudo[86578]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af" returned: 0 in 1.310s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:31 devstack sudo[86586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 1G Apr 13 11:02:31 devstack sudo[86586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Flow 'volume_create_manager' (6cf0844d-7d0f-48c9-9298-0c51413e3516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180bc55e-fb92-4348-a8d7-109c578fdcca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (180bc55e-fb92-4348-a8d7-109c578fdcca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1087728758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a088c563-9f8c-44fe-955d-4f32d184fcda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110daf128f4247229709681a254fb0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:32Z,use_quota=True,user_id='8f93913e01f244b49e53436d0db4f5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1e2e33-a70f-4585-8c72-7f58d4dd66d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba1e2e33-a70f-4585-8c72-7f58d4dd66d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f447f2eb-741a-47b9-9cc3-dc52a268bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f447f2eb-741a-47b9-9cc3-dc52a268bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a088c563-9f8c-44fe-955d-4f32d184fcda', 'volume_name': 'volume-a088c563-9f8c-44fe-955d-4f32d184fcda', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3894bf8-2b26-4f2a-acc6-cd7d977597b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3894bf8-2b26-4f2a-acc6-cd7d977597b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ba3d40-1190-4738-a338-74bdfd927991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:32 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Volume a088c563-9f8c-44fe-955d-4f32d184fcda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a088c563-9f8c-44fe-955d-4f32d184fcda', 'volume_size': 1} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:32 devstack sudo[86586]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 1G" returned: 0 in 1.039s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:32 devstack sudo[86657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 Apr 13 11:02:32 devstack sudo[86657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:33 devstack sudo[86657]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655" returned: 0 in 0.746s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:33 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 is being set with open permissions: ugo+rw Apr 13 11:02:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:33 devstack sudo[86665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 Apr 13 11:02:33 devstack sudo[86665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Flow 'volume_create_manager' (966c61af-36f3-40a0-ade8-ac5b6762826c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6d27f7-73ab-4820-a0d4-c1b0a1491197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:34 devstack sudo[86665]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655" returned: 0 in 0.912s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da6d27f7-73ab-4820-a0d4-c1b0a1491197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1558809586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974e9bed-67dd-4e6a-81cf-1f92ca99cd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de0f09d170c43519a1384e059753042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:34Z,use_quota=True,user_id='a0c3aaa187e844f5a8fee6a242f3b762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2125233-1b70-4c57-afed-dc0fa2100ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2125233-1b70-4c57-afed-dc0fa2100ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d98c1f-9594-49cb-99cc-4cd7d01fbf6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8d98c1f-9594-49cb-99cc-4cd7d01fbf6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974e9bed-67dd-4e6a-81cf-1f92ca99cd8e', 'volume_name': 'volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829faaa8-00b8-42ee-8adf-9e3a115e3f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (829faaa8-00b8-42ee-8adf-9e3a115e3f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f73ef1b-d6a5-4014-8620-e8abe3b22053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:34 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Volume 974e9bed-67dd-4e6a-81cf-1f92ca99cd8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e', 'volume_size': 1} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:34 devstack sudo[86671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.info Apr 13 11:02:34 devstack sudo[86671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:34 devstack sudo[86671]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.info" returned: 0 in 0.430s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:34 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.info is being set with open permissions: ugo+rw Apr 13 11:02:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:34 devstack sudo[86674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.info Apr 13 11:02:34 devstack sudo[86674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:35 devstack sudo[86674]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.info" returned: 0 in 0.522s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.148s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.261s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1087728758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a088c563-9f8c-44fe-955d-4f32d184fcda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110daf128f4247229709681a254fb0fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:32Z,use_quota=True,user_id='8f93913e01f244b49e53436d0db4f5f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Creating volume a088c563-9f8c-44fe-955d-4f32d184fcda {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:35 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:35 devstack sudo[86677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda 1073741824 Apr 13 11:02:35 devstack sudo[86677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:35 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-91c4d244-54a9-48a4-9baa-bfa1e54a3919 tempest-VolumesSnapshotListTestJSON-906848224 None] Create snapshot completed successfully Apr 13 11:02:35 devstack sudo[86677]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda 1073741824" returned: 0 in 0.567s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:35 devstack sudo[86682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda Apr 13 11:02:35 devstack sudo[86682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:36 devstack sudo[86682]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda" returned: 0 in 0.534s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.126s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1558809586',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974e9bed-67dd-4e6a-81cf-1f92ca99cd8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9de0f09d170c43519a1384e059753042',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:34Z,use_quota=True,user_id='a0c3aaa187e844f5a8fee6a242f3b762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Creating volume 974e9bed-67dd-4e6a-81cf-1f92ca99cd8e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:36 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:36 devstack sudo[86685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e 1073741824 Apr 13 11:02:36 devstack sudo[86685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ba3d40-1190-4738-a338-74bdfd927991) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a088c563-9f8c-44fe-955d-4f32d184fcda', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8968185-c297-4592-8210-dae9bf57135b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:36 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Volume volume-a088c563-9f8c-44fe-955d-4f32d184fcda (a088c563-9f8c-44fe-955d-4f32d184fcda): created successfully Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8968185-c297-4592-8210-dae9bf57135b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Flow 'volume_create_manager' (6cf0844d-7d0f-48c9-9298-0c51413e3516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-040a66a2-3bdc-42a8-930b-199914ccbd02 tempest-AbsoluteLimitsTests-1259457222 None] Created volume successfully. Apr 13 11:02:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:37 devstack sudo[86685]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e 1073741824" returned: 0 in 0.543s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:37 devstack sudo[86690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e Apr 13 11:02:37 devstack sudo[86690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Acquiring lock "cinder-a088c563-9f8c-44fe-955d-4f32d184fcda-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Lock "cinder-a088c563-9f8c-44fe-955d-4f32d184fcda-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Acquiring lock "cinder-quobyte-a088c563-9f8c-44fe-955d-4f32d184fcda" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Lock "cinder-quobyte-a088c563-9f8c-44fe-955d-4f32d184fcda" acquired by "delete_volume" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:37 devstack sudo[86690]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e" returned: 0 in 0.614s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.049s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b9cb71-9a2c-4a37-8be5-ab7debf4052b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Creating offline snapshot d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e of volume e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:02:37 devstack sudo[86705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda Apr 13 11:02:37 devstack sudo[86705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f73ef1b-d6a5-4014-8620-e8abe3b22053) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4f43df-5071-4760-a6b2-7e096e519732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:37 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Volume volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e (974e9bed-67dd-4e6a-81cf-1f92ca99cd8e): created successfully Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca4f43df-5071-4760-a6b2-7e096e519732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Flow 'volume_create_manager' (966c61af-36f3-40a0-ade8-ac5b6762826c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40621f7-18f1-4e86-b1fa-24ccefa0f8aa]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (bdf76a8e-ca65-4270-9958-c561627c2afe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41baf681-95d9-4792-9134-296f3de1dbc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:38 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-bb21755d-65e2-4496-beeb-3d89cdafd539 tempest-ServerRescueNegativeTestJSON-1477823248 None] Created volume successfully. Apr 13 11:02:38 devstack sudo[86729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 Apr 13 11:02:38 devstack sudo[86729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41baf681-95d9-4792-9134-296f3de1dbc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-50418885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53732639-654b-4d5b-8a0f-486aef6aa12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:38Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb87b6-06a0-49ee-b808-9004a61b8f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb87b6-06a0-49ee-b808-9004a61b8f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd255d2b-2fbd-463b-abbb-5207edecc938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd255d2b-2fbd-463b-abbb-5207edecc938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53732639-654b-4d5b-8a0f-486aef6aa12c', 'volume_name': 'volume-53732639-654b-4d5b-8a0f-486aef6aa12c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2463768d-a8b0-4555-9519-b8c48a004885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2463768d-a8b0-4555-9519-b8c48a004885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b715c2b2-5f4d-4a73-b31c-7abc2f4e4cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Volume 53732639-654b-4d5b-8a0f-486aef6aa12c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53732639-654b-4d5b-8a0f-486aef6aa12c', 'volume_size': 1} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:38 devstack sudo[86705]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda" returned: 0 in 0.809s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:38 devstack sudo[86737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda Apr 13 11:02:38 devstack sudo[86737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:38 devstack sudo[86729]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655" returned: 0 in 0.646s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:38 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e 1G Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:38 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:38 devstack sudo[86741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:38 devstack sudo[86741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:39 devstack sudo[86737]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a088c563-9f8c-44fe-955d-4f32d184fcda" returned: 0 in 0.813s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Lock "cinder-quobyte-a088c563-9f8c-44fe-955d-4f32d184fcda" released by "delete_volume" :: held 1.719s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:39 devstack sudo[86741]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.692s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Created reservations ['50fdd836-0e26-45cb-bf2d-78c80e4a9565', '3001acc5-1c0d-40e4-b9d3-07704cc99ccd', '058c6261-52fa-4c74-b9d5-97658cb99868', 'ef34b6d3-9038-4af5-a3eb-55e97a33a8fc'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:39 devstack sudo[86749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:39 devstack sudo[86749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:39 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e 1G" returned: 0 in 0.928s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:39 devstack sudo[86751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e Apr 13 11:02:39 devstack sudo[86751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:39 devstack sudo[86749]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.458s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Deleted volume successfully. Apr 13 11:02:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8ebf227-de5c-451d-94dc-09a6b7766c63 tempest-AbsoluteLimitsTests-1259457222 None] Lock "cinder-a088c563-9f8c-44fe-955d-4f32d184fcda-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:40 devstack sudo[86751]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" returned: 0 in 1.029s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:40 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e is being set with open permissions: ugo+rw Apr 13 11:02:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:40 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e Apr 13 11:02:40 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:41 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" returned: 0 in 0.593s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.588s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.091s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-50418885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53732639-654b-4d5b-8a0f-486aef6aa12c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:38Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Creating volume 53732639-654b-4d5b-8a0f-486aef6aa12c {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:41 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:41 devstack sudo[86761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c 1073741824 Apr 13 11:02:41 devstack sudo[86761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:41 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-407f9eab-00a8-4615-a8af-e15c5a665db4 tempest-VolumesSnapshotListTestJSON-906848224 None] Create snapshot completed successfully Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:42 devstack sudo[86761]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c 1073741824" returned: 0 in 1.015s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:42 devstack sudo[86769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c Apr 13 11:02:42 devstack sudo[86769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:42 devstack sudo[86769]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c" returned: 0 in 0.580s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] <== create_volume: return (1645ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.878s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b715c2b2-5f4d-4a73-b31c-7abc2f4e4cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53732639-654b-4d5b-8a0f-486aef6aa12c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea79151-d1d9-4e9b-811c-30846ec5dca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Creating offline snapshot 9d211568-9192-4e41-aab9-d61ed8905ce9 of volume e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5535e272-5274-4e1e-bc60-09edd6aa395f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:43 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Volume volume-53732639-654b-4d5b-8a0f-486aef6aa12c (53732639-654b-4d5b-8a0f-486aef6aa12c): created successfully Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ea79151-d1d9-4e9b-811c-30846ec5dca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (bdf76a8e-ca65-4270-9958-c561627c2afe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6738f053-510a-4f9f-853b-e0780acb4066 tempest-VolumesActionsTest-1635315142 None] Created volume successfully. Apr 13 11:02:43 devstack sudo[86795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e Apr 13 11:02:43 devstack sudo[86795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-53732639-654b-4d5b-8a0f-486aef6aa12c-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Lock "cinder-53732639-654b-4d5b-8a0f-486aef6aa12c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-quobyte-53732639-654b-4d5b-8a0f-486aef6aa12c" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Lock "cinder-quobyte-53732639-654b-4d5b-8a0f-486aef6aa12c" acquired by "delete_volume" :: waited 0.020s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4acd3ec-b8c9-4c79-82a9-8e396cb2d409]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:43 devstack sudo[86798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c Apr 13 11:02:43 devstack sudo[86798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:43 devstack sudo[86795]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" returned: 0 in 0.794s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:02:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:43 devstack sudo[86804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 1G Apr 13 11:02:43 devstack sudo[86804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:44 devstack sudo[86798]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c" returned: 0 in 0.588s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:44 devstack sudo[86814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c Apr 13 11:02:44 devstack sudo[86814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:44 devstack sudo[86804]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 1G" returned: 0 in 0.630s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:44 devstack sudo[86819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 Apr 13 11:02:44 devstack sudo[86819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:44 devstack sudo[86814]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-53732639-654b-4d5b-8a0f-486aef6aa12c" returned: 0 in 0.555s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Lock "cinder-quobyte-53732639-654b-4d5b-8a0f-486aef6aa12c" released by "delete_volume" :: held 1.176s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Created reservations ['8ea687ad-ee7d-47b8-834e-8b9b62562fd9', 'a89b6df2-7e62-4469-bd99-2a88ffd68111', 'ac5ff3bb-978a-4ca9-866c-f7d949118786', 'c3475899-1b04-43d8-ba8e-2f508220211c'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:44 devstack sudo[86822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:44 devstack sudo[86822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Flow 'volume_create_manager' (bada71a2-fb75-4382-9287-3aa98cbfc70b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d0ae6e-721b-40f4-b1b7-63d60746fbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2d0ae6e-721b-40f4-b1b7-63d60746fbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1523729564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4b06b9-4d98-41a1-b852-eb50af44d9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74484e79f38943619fa50887591dfad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:45Z,use_quota=True,user_id='0c5906207a4248a1b277bff5e070682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5197634-dc4e-4e5a-8293-1f79c8160711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5197634-dc4e-4e5a-8293-1f79c8160711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d54fe-4622-4a4f-b354-f3f16d7c8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b0d54fe-4622-4a4f-b354-f3f16d7c8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd4b06b9-4d98-41a1-b852-eb50af44d9ba', 'volume_name': 'volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861ef19a-7218-4a21-a089-5d5e0cb2b3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (861ef19a-7218-4a21-a089-5d5e0cb2b3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5b1e37-647d-4959-9bbf-721480956f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:45 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Volume cd4b06b9-4d98-41a1-b852-eb50af44d9ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba', 'volume_size': 1} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:45 devstack sudo[86819]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9" returned: 0 in 0.612s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:45 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 is being set with open permissions: ugo+rw Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:45 devstack sudo[86827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 Apr 13 11:02:45 devstack sudo[86827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:45 devstack sudo[86822]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.483s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Deleted volume successfully. Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f0a48d68-f9eb-4536-bd65-dea539e6bbca tempest-VolumesActionsTest-479573529 None] Lock "cinder-53732639-654b-4d5b-8a0f-486aef6aa12c-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:45 devstack sudo[86827]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9" returned: 0 in 0.408s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.550s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.496s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1523729564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd4b06b9-4d98-41a1-b852-eb50af44d9ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74484e79f38943619fa50887591dfad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:45Z,use_quota=True,user_id='0c5906207a4248a1b277bff5e070682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Creating volume cd4b06b9-4d98-41a1-b852-eb50af44d9ba {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:45 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:45 devstack sudo[86831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba 1073741824 Apr 13 11:02:45 devstack sudo[86831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-de7b27b5-82c6-45f8-98e3-82a7f5cdb18a tempest-VolumesSnapshotListTestJSON-906848224 None] Create snapshot completed successfully Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:46 devstack sudo[86831]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (c8cfc336-8dc6-452f-9432-b5ca47a9d25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d40c41b-9f65-4728-83db-af372473d92f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d40c41b-9f65-4728-83db-af372473d92f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-870864137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90097ac2-300a-425c-a798-0b47f7dd9bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:46Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb29260-593c-4710-b37b-c1ab4bb24ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bb29260-593c-4710-b37b-c1ab4bb24ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f346f9-b4cd-4c62-8873-d84bf07630ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7f346f9-b4cd-4c62-8873-d84bf07630ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90097ac2-300a-425c-a798-0b47f7dd9bee', 'volume_name': 'volume-90097ac2-300a-425c-a798-0b47f7dd9bee', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b53b99-bb06-41db-8b48-321a6174cfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b53b99-bb06-41db-8b48-321a6174cfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958f961e-f9af-4025-bdf8-8bd2bdcc2a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:46 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Volume 90097ac2-300a-425c-a798-0b47f7dd9bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90097ac2-300a-425c-a798-0b47f7dd9bee', 'volume_size': 1} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba 1073741824" returned: 0 in 0.634s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:46 devstack sudo[86837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba Apr 13 11:02:46 devstack sudo[86837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:46 devstack sudo[86837]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba" returned: 0 in 0.521s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.553s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-870864137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90097ac2-300a-425c-a798-0b47f7dd9bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:46Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Creating volume 90097ac2-300a-425c-a798-0b47f7dd9bee {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:46 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:46 devstack sudo[86840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee 1073741824 Apr 13 11:02:46 devstack sudo[86840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5b1e37-647d-4959-9bbf-721480956f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9864ede-4075-4daa-96a8-685f06a5380b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:46 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Volume volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba (cd4b06b9-4d98-41a1-b852-eb50af44d9ba): created successfully Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9864ede-4075-4daa-96a8-685f06a5380b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Flow 'volume_create_manager' (bada71a2-fb75-4382-9287-3aa98cbfc70b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:46 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-918d0008-f304-434f-b7f3-11690385b9b5 tempest-VolumesTransfersV357Test-220984980 None] Created volume successfully. Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-9d211568-9192-4e41-aab9-d61ed8905ce9-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-9d211568-9192-4e41-aab9-d61ed8905ce9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-quobyte-9d211568-9192-4e41-aab9-d61ed8905ce9" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-9d211568-9192-4e41-aab9-d61ed8905ce9" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Deleting offline snapshot 9d211568-9192-4e41-aab9-d61ed8905ce9 of volume e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] snapshot_file for this snap is: volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[120b2a64-5d24-439c-96d3-e1d318d96c2a]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:47 devstack sudo[86842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 Apr 13 11:02:47 devstack sudo[86842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:47 devstack sudo[86842]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9" returned: 0 in 0.998s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:02:47 devstack sudo[86840]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee 1073741824" returned: 0 in 1.255s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[76182119-8486-45c1-86d6-4f29560f0d46]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:48 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0da74e37-ab81-42bd-9175-1ed0c7448cd2 tempest-VolumesTransfersV357Test-2094665920 None] Transfer volume completed successfully. Apr 13 11:02:48 devstack sudo[86879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e Apr 13 11:02:48 devstack sudo[86879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:48 devstack sudo[86880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee Apr 13 11:02:48 devstack sudo[86880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:48 devstack sudo[86880]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee" returned: 0 in 0.853s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] <== create_volume: return (2220ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.223s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (958f961e-f9af-4025-bdf8-8bd2bdcc2a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90097ac2-300a-425c-a798-0b47f7dd9bee', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5307d24a-c4b9-42ef-9771-8974021677b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Volume volume-90097ac2-300a-425c-a798-0b47f7dd9bee (90097ac2-300a-425c-a798-0b47f7dd9bee): created successfully Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5307d24a-c4b9-42ef-9771-8974021677b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (c8cfc336-8dc6-452f-9432-b5ca47a9d25d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:48 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-166f9c3d-3d36-4b04-a7a3-1bd515034c46 tempest-VolumesActionsTest-1635315142 None] Created volume successfully. Apr 13 11:02:49 devstack sudo[86879]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" returned: 0 in 1.049s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:49 devstack sudo[86888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 Apr 13 11:02:49 devstack sudo[86888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Acquiring lock "cinder-cd4b06b9-4d98-41a1-b852-eb50af44d9ba-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Lock "cinder-cd4b06b9-4d98-41a1-b852-eb50af44d9ba-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Acquiring lock "cinder-quobyte-cd4b06b9-4d98-41a1-b852-eb50af44d9ba" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Lock "cinder-quobyte-cd4b06b9-4d98-41a1-b852-eb50af44d9ba" acquired by "delete_volume" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f16feba-5d23-4683-b446-d633e36ffc02]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-90097ac2-300a-425c-a798-0b47f7dd9bee-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:49 devstack sudo[86890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba Apr 13 11:02:49 devstack sudo[86890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Lock "cinder-90097ac2-300a-425c-a798-0b47f7dd9bee-delete_volume" acquired by "delete_volume" :: waited 0.173s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-quobyte-90097ac2-300a-425c-a798-0b47f7dd9bee" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Lock "cinder-quobyte-90097ac2-300a-425c-a798-0b47f7dd9bee" acquired by "delete_volume" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[845e5a4a-defe-4d31-9384-27f6265df184]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:49 devstack sudo[86892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee Apr 13 11:02:49 devstack sudo[86892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:50 devstack sudo[86888]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9" returned: 0 in 1.047s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:50 devstack sudo[86900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9 Apr 13 11:02:50 devstack sudo[86900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:50 devstack sudo[86890]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba" returned: 0 in 0.884s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:50 devstack sudo[86902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba Apr 13 11:02:50 devstack sudo[86902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:50 devstack sudo[86892]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee" returned: 0 in 0.973s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:50 devstack sudo[86908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee Apr 13 11:02:50 devstack sudo[86908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:50 devstack sudo[86900]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.9d211568-9192-4e41-aab9-d61ed8905ce9" returned: 0 in 0.627s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-9d211568-9192-4e41-aab9-d61ed8905ce9" released by "_delete_snapshot" :: held 3.868s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" released by "delete_snapshot" :: held 3.891s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Created reservations ['4d0aefbe-9e50-4d43-9481-ff5fe42b4faa', 'd0391600-d634-4e37-9e56-1125e233e69d', 'e264feac-e56b-40c5-b1e8-6706c93bc162', '696ed1bf-4c6a-49c4-b06a-403d6af8c0f0'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:50 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Delete snapshot completed successfully. Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d2404cc-954e-4278-9b95-a264a0997feb tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-9d211568-9192-4e41-aab9-d61ed8905ce9-delete_snapshot" released by "delete_snapshot" :: held 3.980s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:50 devstack sudo[86902]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cd4b06b9-4d98-41a1-b852-eb50af44d9ba" returned: 0 in 0.690s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Lock "cinder-quobyte-cd4b06b9-4d98-41a1-b852-eb50af44d9ba" released by "delete_volume" :: held 1.661s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Created reservations ['d5eb8dc5-82d4-49b2-a027-733e7784baac', '5d4c6c24-ea34-49ae-b27c-a2cd58fd1a9c', '6acecdc6-1236-48d8-9c25-de5e4288a6e7', 'c5bd6485-99b5-4a8d-8ac3-3466f98be4a9'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:50 devstack sudo[86911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:50 devstack sudo[86911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:51 devstack sudo[86908]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-90097ac2-300a-425c-a798-0b47f7dd9bee" returned: 0 in 0.544s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Lock "cinder-quobyte-90097ac2-300a-425c-a798-0b47f7dd9bee" released by "delete_volume" :: held 1.577s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-quobyte-d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Deleting offline snapshot d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e of volume e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] snapshot_file for this snap is: volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[37500b5d-fd29-4d39-b4c0-d186e0869eac]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Created reservations ['ec2a9934-d2c6-4a69-8593-67fcc6aba038', '6af16395-cbbc-4b0c-b760-b3534c599458', 'e63b0d30-9167-4a65-b5e1-faef9c4199a0', '0d9388f3-569b-4e0d-911e-699dc4443a14'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:51 devstack sudo[86911]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.596s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:51 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Deleted volume successfully. Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a0c2abc-3cb2-44ca-bc5b-87e79de0ce07 tempest-VolumesTransfersV357Test-1070130051 None] Lock "cinder-cd4b06b9-4d98-41a1-b852-eb50af44d9ba-delete_volume" released by "delete_volume" :: held 2.443s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:51 devstack sudo[86944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:51 devstack sudo[86944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:51 devstack sudo[86921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e Apr 13 11:02:51 devstack sudo[86921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Flow 'volume_create_manager' (dc751c8c-3aac-4077-add5-94121fb5f94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5537b6-3ab9-4b30-a9ce-8b5165c2dcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f5537b6-3ab9-4b30-a9ce-8b5165c2dcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-753077123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0302841d-a9d1-43d4-bf79-de89cccc7054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74484e79f38943619fa50887591dfad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:52Z,use_quota=True,user_id='0c5906207a4248a1b277bff5e070682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d89abc7-5244-4939-a8e2-d5ad42027faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d89abc7-5244-4939-a8e2-d5ad42027faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adde716b-0088-46a9-ae90-0c4d50c9d3c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adde716b-0088-46a9-ae90-0c4d50c9d3c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0302841d-a9d1-43d4-bf79-de89cccc7054', 'volume_name': 'volume-0302841d-a9d1-43d4-bf79-de89cccc7054', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf2be70-7e43-4f0c-af45-f108fe99e955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcf2be70-7e43-4f0c-af45-f108fe99e955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc5e4ca-6148-4819-862b-f614b7b06ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Volume 0302841d-a9d1-43d4-bf79-de89cccc7054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0302841d-a9d1-43d4-bf79-de89cccc7054', 'volume_size': 1} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-753077123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0302841d-a9d1-43d4-bf79-de89cccc7054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74484e79f38943619fa50887591dfad5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:52Z,use_quota=True,user_id='0c5906207a4248a1b277bff5e070682f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Creating volume 0302841d-a9d1-43d4-bf79-de89cccc7054 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:52 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:52 devstack sudo[86964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 1073741824 Apr 13 11:02:52 devstack sudo[86964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (f8501f8a-1cc4-43f4-ba24-3c11eed76431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b640e78e-a2f7-4a86-8857-65f3b35f64c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b640e78e-a2f7-4a86-8857-65f3b35f64c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1622578128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0419e0-7dfa-4529-8944-d9deba3278e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:52Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1761e790-cd38-4424-a3f5-b81d8f7169c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1761e790-cd38-4424-a3f5-b81d8f7169c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bc80f1-5f49-4d0c-be60-ca49a1db3620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33bc80f1-5f49-4d0c-be60-ca49a1db3620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0419e0-7dfa-4529-8944-d9deba3278e0', 'volume_name': 'volume-8f0419e0-7dfa-4529-8944-d9deba3278e0', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f41b73-66ae-4d9f-852f-cd81ba43939d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f41b73-66ae-4d9f-852f-cd81ba43939d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48e7160-899f-4a26-90f0-59ac7619caae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:52 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Volume 8f0419e0-7dfa-4529-8944-d9deba3278e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0419e0-7dfa-4529-8944-d9deba3278e0', 'volume_size': 1} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:52 devstack sudo[86944]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.218s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:52 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Deleted volume successfully. Apr 13 11:02:52 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5644d29-c619-42d1-a4d6-e8d0b137d354 tempest-VolumesActionsTest-479573529 None] Lock "cinder-90097ac2-300a-425c-a798-0b47f7dd9bee-delete_volume" released by "delete_volume" :: held 3.297s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:53 devstack sudo[86921]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" returned: 0 in 1.648s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d83ce0-6543-41e3-9080-d8a3ebdebb47]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:53 devstack sudo[86984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 Apr 13 11:02:53 devstack sudo[86984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:53 devstack sudo[86964]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 1073741824" returned: 0 in 1.273s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:53 devstack sudo[86986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 Apr 13 11:02:53 devstack sudo[86986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:53 devstack sudo[86984]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655" returned: 0 in 0.594s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:53 devstack sudo[86991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e Apr 13 11:02:53 devstack sudo[86991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:53 devstack sudo[86986]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054" returned: 0 in 0.488s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] <== create_volume: return (1832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.835s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.309s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:02:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1622578128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0419e0-7dfa-4529-8944-d9deba3278e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:02:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:02:52Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Creating volume 8f0419e0-7dfa-4529-8944-d9deba3278e0 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:02:53 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (edc5e4ca-6148-4819-862b-f614b7b06ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0302841d-a9d1-43d4-bf79-de89cccc7054', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c29e9d-513b-4056-a82c-d7ea03836aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:53 devstack sudo[86994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 1073741824 Apr 13 11:02:53 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=133,cinder:SELECT=123,cinder:INSERT=38,cinder:DELETE=16 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:02:53 devstack sudo[86994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:54 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Volume volume-0302841d-a9d1-43d4-bf79-de89cccc7054 (0302841d-a9d1-43d4-bf79-de89cccc7054): created successfully Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2c29e9d-513b-4056-a82c-d7ea03836aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Flow 'volume_create_manager' (dc751c8c-3aac-4077-add5-94121fb5f94a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d04c3adb-3325-4b86-a73c-6d5c55edb0c2 tempest-VolumesTransfersV357Test-220984980 None] Created volume successfully. Apr 13 11:02:54 devstack sudo[86991]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" returned: 0 in 0.596s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:54 devstack sudo[86999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e Apr 13 11:02:54 devstack sudo[86999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Acquiring lock "cinder-0302841d-a9d1-43d4-bf79-de89cccc7054-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Lock "cinder-0302841d-a9d1-43d4-bf79-de89cccc7054-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Acquiring lock "cinder-quobyte-0302841d-a9d1-43d4-bf79-de89cccc7054" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Lock "cinder-quobyte-0302841d-a9d1-43d4-bf79-de89cccc7054" acquired by "delete_volume" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Acquiring lock "cinder-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "cinder-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9b604e-2b15-4da4-a5ee-30bd5627b78e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Acquiring lock "cinder-quobyte-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "cinder-quobyte-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e" acquired by "delete_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[71996b7f-3ebe-4168-9390-948504f1ef41]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:55 devstack sudo[87004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 Apr 13 11:02:55 devstack sudo[87004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:55 devstack sudo[86994]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 1073741824" returned: 0 in 1.109s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:55 devstack sudo[87008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 Apr 13 11:02:55 devstack sudo[87008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:55 devstack sudo[87005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e Apr 13 11:02:55 devstack sudo[87005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:55 devstack sudo[86999]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" returned: 0 in 0.905s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e" released by "_delete_snapshot" :: held 3.872s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" released by "delete_snapshot" :: held 3.898s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Created reservations ['a336c89d-4b9b-4040-a649-43cbfe1fd939', '1f329479-06b8-4a56-8805-e49638ff19ac', '857baa7a-dd8b-4e34-8fcb-c8854c2f660f', '9a50086e-3741-42ed-ad56-e44668fd2930'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:55 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Delete snapshot completed successfully. Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6cae999-b176-41f5-832c-e54d255e47e0 tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-d945fa2f-a7ca-47e2-a4ef-0437a6a3ac7e-delete_snapshot" released by "delete_snapshot" :: held 4.077s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-f5a2c508-84d5-4ca5-8e34-f7c78fefe655-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-f5a2c508-84d5-4ca5-8e34-f7c78fefe655-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" acquired by "delete_snapshot" :: waited 0.036s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-quobyte-f5a2c508-84d5-4ca5-8e34-f7c78fefe655" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:55 devstack sudo[87005]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e" returned: 0 in 0.642s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-f5a2c508-84d5-4ca5-8e34-f7c78fefe655" acquired by "_delete_snapshot" :: waited 0.071s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:55 devstack sudo[87014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e Apr 13 11:02:55 devstack sudo[87014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Deleting offline snapshot f5a2c508-84d5-4ca5-8e34-f7c78fefe655 of volume e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] snapshot_file for this snap is: volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1849673-152c-4404-a62a-74a176b6ef01]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:55 devstack sudo[87004]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054" returned: 0 in 1.024s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:55 devstack sudo[87017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 Apr 13 11:02:55 devstack sudo[87017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:55 devstack sudo[87021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054 Apr 13 11:02:55 devstack sudo[87021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:55 devstack sudo[87008]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0" returned: 0 in 0.884s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] <== create_volume: return (2027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:02:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48e7160-899f-4a26-90f0-59ac7619caae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0419e0-7dfa-4529-8944-d9deba3278e0', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830dff9f-189d-4d91-81d1-abb51cd2f439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:02:56 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Volume volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 (8f0419e0-7dfa-4529-8944-d9deba3278e0): created successfully Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (830dff9f-189d-4d91-81d1-abb51cd2f439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (f8501f8a-1cc4-43f4-ba24-3c11eed76431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:02:56 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0900f997-14fe-4603-ab1c-657979a596b5 tempest-VolumesActionsTest-1635315142 None] Created volume successfully. Apr 13 11:02:56 devstack sudo[87014]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:56 devstack sudo[87021]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e" returned: 0 in 0.832s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "cinder-quobyte-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e" released by "delete_volume" :: held 1.508s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0302841d-a9d1-43d4-bf79-de89cccc7054" returned: 0 in 0.615s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Lock "cinder-quobyte-0302841d-a9d1-43d4-bf79-de89cccc7054" released by "delete_volume" :: held 1.729s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Created reservations ['023b013b-afbd-4cf9-a7e7-7ac1be466711', '10a2236c-5e3f-4755-9209-0a550f0410db', '17decbb3-0fac-4049-a21f-cff800b3b575', '6c1229ed-88a5-4e53-bf76-62b88c87c5a7'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:56 devstack sudo[87017]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Created reservations ['ac19dbdc-9525-4da6-9b72-1d3bc8c7bea7', '9fb8a4e0-0032-4e18-b0dd-3afbda97b59b', 'd4f1016b-f345-475c-9444-1045c1df3de6', '7842fd39-5ef3-4de4-90ae-da5dd7444c45'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655" returned: 0 in 0.861s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:56 devstack sudo[87029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:56 devstack sudo[87029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2be852c8-6fbb-4a17-a839-6d9fc647d7fe]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:56 devstack sudo[87031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:56 devstack sudo[87031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:56 devstack sudo[87032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af Apr 13 11:02:56 devstack sudo[87032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-8f0419e0-7dfa-4529-8944-d9deba3278e0-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Lock "cinder-8f0419e0-7dfa-4529-8944-d9deba3278e0-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-quobyte-8f0419e0-7dfa-4529-8944-d9deba3278e0" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Lock "cinder-quobyte-8f0419e0-7dfa-4529-8944-d9deba3278e0" acquired by "delete_volume" :: waited 0.029s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1548757f-5a6d-434b-b5a6-f0bf76d5b5b6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:57 devstack sudo[87029]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.926s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:57 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Deleted volume successfully. Apr 13 11:02:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-67e69661-6931-4314-ae7e-dc3667068b9f tempest-ServerRescueNegativeTestJSON-1477823248 None] Lock "cinder-974e9bed-67dd-4e6a-81cf-1f92ca99cd8e-delete_volume" released by "delete_volume" :: held 2.764s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:57 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 Apr 13 11:02:57 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:58 devstack sudo[87031]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.306s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:02:58 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Deleted volume successfully. Apr 13 11:02:58 devstack sudo[87032]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af" returned: 0 in 1.358s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6ae0b961-6066-4071-9d3f-af32eab2aac6 tempest-VolumesTransfersV357Test-1070130051 None] Lock "cinder-0302841d-a9d1-43d4-bf79-de89cccc7054-delete_volume" released by "delete_volume" :: held 3.392s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:58 devstack sudo[87047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 Apr 13 11:02:58 devstack sudo[87047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:58 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0" returned: 0 in 1.366s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:58 devstack sudo[87080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0 Apr 13 11:02:58 devstack sudo[87080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:58 devstack sudo[87047]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655" returned: 0 in 0.719s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:58 devstack sudo[87082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655 Apr 13 11:02:58 devstack sudo[87082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:59 devstack sudo[87080]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8f0419e0-7dfa-4529-8944-d9deba3278e0" returned: 0 in 0.785s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:59 devstack sudo[87082]: pam_unix(sudo:session): session closed for user root Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af.f5a2c508-84d5-4ca5-8e34-f7c78fefe655" returned: 0 in 0.742s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Lock "cinder-quobyte-8f0419e0-7dfa-4529-8944-d9deba3278e0" released by "delete_volume" :: held 2.202s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-f5a2c508-84d5-4ca5-8e34-f7c78fefe655" released by "_delete_snapshot" :: held 3.899s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" released by "delete_snapshot" :: held 3.976s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Created reservations ['b3ff48b7-8e40-4776-b4eb-06e3023177e9', '78d7e743-5788-40d7-83e2-486c1aefef50', '5d146b3c-8e77-4969-a271-54853e5337d0', '336aacaf-670b-459b-8f52-99e1f00dbd10'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Created reservations ['2128125e-efdd-4121-84df-8f3c5604e8c6', '8969b598-474f-47e3-aeea-69f5fa58f334', '497f92f4-4d25-4f8f-9682-fe0049fceae9', 'd62e150f-75c6-4fe0-ad24-95593ac9c116'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:02:59 devstack sudo[87088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:02:59 devstack sudo[87088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:02:59 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Delete snapshot completed successfully. Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b4b7b10c-1ed7-4df5-b303-8327c4de8b3b tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-f5a2c508-84d5-4ca5-8e34-f7c78fefe655-delete_snapshot" released by "delete_snapshot" :: held 4.181s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-e69fcdcd-5a93-4d60-ae71-4318bbada9af-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-e69fcdcd-5a93-4d60-ae71-4318bbada9af-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:02:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:00 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd88918-3700-47db-ba13-195f503f1b9c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:00 devstack sudo[87091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af Apr 13 11:03:00 devstack sudo[87091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:00 devstack sudo[87088]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.634s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:00 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:00 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Deleted volume successfully. Apr 13 11:03:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dab68838-28e9-48c5-a10d-aad2d0b146e3 tempest-VolumesActionsTest-479573529 None] Lock "cinder-8f0419e0-7dfa-4529-8944-d9deba3278e0-delete_volume" released by "delete_volume" :: held 3.179s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:00 devstack sudo[87091]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af" returned: 0 in 0.799s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:00 devstack sudo[87098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af Apr 13 11:03:00 devstack sudo[87098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (8f374bc2-35b4-4f96-acdc-5b7baf35472f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c984c6-029a-463e-b58d-cfd96bf23dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c984c6-029a-463e-b58d-cfd96bf23dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-520893075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8627bebd-2fe9-4e3d-8c87-983fca4ccf44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:01Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b312f8-15f6-46e4-8fcf-af55727073aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57b312f8-15f6-46e4-8fcf-af55727073aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ac76a1-9eef-4ef1-bdff-f25141ed33ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8ac76a1-9eef-4ef1-bdff-f25141ed33ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8627bebd-2fe9-4e3d-8c87-983fca4ccf44', 'volume_name': 'volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3dbe5b-b097-4a30-93e5-a2df12f0463b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa3dbe5b-b097-4a30-93e5-a2df12f0463b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbde1e1-b791-4c8c-b019-690d0bfdd545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:01 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Volume 8627bebd-2fe9-4e3d-8c87-983fca4ccf44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44', 'volume_size': 1} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-520893075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8627bebd-2fe9-4e3d-8c87-983fca4ccf44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:01Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Creating volume 8627bebd-2fe9-4e3d-8c87-983fca4ccf44 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:01 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:01 devstack sudo[87100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 1073741824 Apr 13 11:03:01 devstack sudo[87100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:01 devstack sudo[87098]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e69fcdcd-5a93-4d60-ae71-4318bbada9af" returned: 0 in 0.665s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-quobyte-e69fcdcd-5a93-4d60-ae71-4318bbada9af" released by "delete_volume" :: held 1.509s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Created reservations ['d922576b-9a7c-4009-be24-4d937ab71e52', '4254e3a7-eb28-419b-ad0c-ed260c1fda47', '9ea3aaff-f063-43f1-a769-6426e573e058', '6d5df748-caca-43d7-9994-ebacea30a6b4'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:01 devstack sudo[87103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:01 devstack sudo[87103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:02 devstack sudo[87100]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 1073741824" returned: 0 in 1.042s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:02 devstack sudo[87110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 Apr 13 11:03:02 devstack sudo[87110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:02 devstack sudo[87103]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.749s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:02 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Deleted volume successfully. Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fadb8e20-68a1-467d-bc29-5cc73715852c tempest-VolumesSnapshotListTestJSON-906848224 None] Lock "cinder-e69fcdcd-5a93-4d60-ae71-4318bbada9af-delete_volume" released by "delete_volume" :: held 2.471s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:02 devstack sudo[87110]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44" returned: 0 in 0.619s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] <== create_volume: return (1718ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.721s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dbde1e1-b791-4c8c-b019-690d0bfdd545) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3d5b02-662a-4766-8611-2d8ea8087b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:02 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Volume volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 (8627bebd-2fe9-4e3d-8c87-983fca4ccf44): created successfully Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e3d5b02-662a-4766-8611-2d8ea8087b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (8f374bc2-35b4-4f96-acdc-5b7baf35472f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:02 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-09dbfef7-36f5-42b2-933e-352545ac9af5 tempest-VolumesActionsTest-1635315142 None] Created volume successfully. Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Flow 'volume_create_manager' (492247af-665e-495d-95a9-4810fe4f765f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a61455-4324-4029-a615-51bb57157b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47a61455-4324-4029-a615-51bb57157b70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1623793240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974f881e-1d7c-4ae7-bde5-ebe1f5b015d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0908551483d452d9a6b7a00b2c540d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:03Z,use_quota=True,user_id='e50e00cd29d44823a21a067a071e5898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e9ca53-064e-415a-a08b-26307b4971fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e9ca53-064e-415a-a08b-26307b4971fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c6aeb9-80f1-4791-a0cd-f005f8ea21c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c6aeb9-80f1-4791-a0cd-f005f8ea21c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '974f881e-1d7c-4ae7-bde5-ebe1f5b015d7', 'volume_name': 'volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7', 'volume_size': 2}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d3f0a5-4b1e-47a8-bbe5-70cfb567a494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5d3f0a5-4b1e-47a8-bbe5-70cfb567a494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df3f775-18f8-47e5-9868-3e6f64322d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:03 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Volume 974f881e-1d7c-4ae7-bde5-ebe1f5b015d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7', 'volume_size': 2} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1623793240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=974f881e-1d7c-4ae7-bde5-ebe1f5b015d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0908551483d452d9a6b7a00b2c540d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:03Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:03Z,use_quota=True,user_id='e50e00cd29d44823a21a067a071e5898',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Creating volume 974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:03 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 2147483648 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-8627bebd-2fe9-4e3d-8c87-983fca4ccf44-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:03 devstack sudo[87113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 2147483648 Apr 13 11:03:03 devstack sudo[87113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Lock "cinder-8627bebd-2fe9-4e3d-8c87-983fca4ccf44-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Acquiring lock "cinder-quobyte-8627bebd-2fe9-4e3d-8c87-983fca4ccf44" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Lock "cinder-quobyte-8627bebd-2fe9-4e3d-8c87-983fca4ccf44" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[36bc086c-928b-48f0-b613-faa0b08ce63f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:03 devstack sudo[87115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 Apr 13 11:03:03 devstack sudo[87115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:04 devstack sudo[87113]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 2147483648" returned: 0 in 0.868s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:04 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=177,cinder:SELECT=126,cinder:INSERT=44,cinder:DELETE=13 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:03:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:04 devstack sudo[87115]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44" returned: 0 in 0.852s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:04 devstack sudo[87125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 Apr 13 11:03:04 devstack sudo[87125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:04 devstack sudo[87126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44 Apr 13 11:03:04 devstack sudo[87126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:05 devstack sudo[87125]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (cfe3048f-f290-4d0c-a318-ea9bbd27bb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b939c764-4461-44fc-b30b-59c5252fe018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b939c764-4461-44fc-b30b-59c5252fe018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-695521703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4540105b-522c-4f8b-a86d-8dfc60ef4fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:05Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d334b0d-ad63-4f68-8e0c-323281e0e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d334b0d-ad63-4f68-8e0c-323281e0e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e627696-ee82-4ac9-ba7a-e091e97fe928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e627696-ee82-4ac9-ba7a-e091e97fe928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4540105b-522c-4f8b-a86d-8dfc60ef4fe6', 'volume_name': 'volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d40bef2-e4ac-4438-9d54-f7c8ce1fb0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack sudo[87126]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d40bef2-e4ac-4438-9d54-f7c8ce1fb0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f18f59-4345-4fd4-befb-bf199f3b13a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Volume 4540105b-522c-4f8b-a86d-8dfc60ef4fe6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6', 'volume_size': 1} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7" returned: 0 in 0.800s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8627bebd-2fe9-4e3d-8c87-983fca4ccf44" returned: 0 in 0.729s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-695521703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4540105b-522c-4f8b-a86d-8dfc60ef4fe6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:05Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Creating volume 4540105b-522c-4f8b-a86d-8dfc60ef4fe6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:05 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9df3f775-18f8-47e5-9868-3e6f64322d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7', 'volume_size': 2}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ddea0b-be9f-48ce-a72d-45208c69b9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack sudo[87137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 1073741824 Apr 13 11:03:05 devstack sudo[87137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Lock "cinder-quobyte-8627bebd-2fe9-4e3d-8c87-983fca4ccf44" released by "delete_volume" :: held 1.664s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:05 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Volume volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 (974f881e-1d7c-4ae7-bde5-ebe1f5b015d7): created successfully Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2ddea0b-be9f-48ce-a72d-45208c69b9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Flow 'volume_create_manager' (492247af-665e-495d-95a9-4810fe4f765f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-a707dadc-1673-400d-9c0a-1dd695b50a7c tempest-VolumesCloneNegativeTest-1693845606 None] Created volume successfully. Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Created reservations ['28c6f1ea-41b5-4858-9ee8-65e512a8b830', '9194335f-c41b-4972-a4e6-4e36c5fec4b1', '059d9ddc-1411-4084-a361-5fa242a0d0ba', '0c70eec0-95f3-44dd-b50c-13cbd6210344'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:05 devstack sudo[87147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:05 devstack sudo[87147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (445d5457-5b2f-4665-938d-2238c42b1558) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeee3d99-6f47-4949-a265-0bfd45d5193b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeee3d99-6f47-4949-a265-0bfd45d5193b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257037682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0059232c-7d2f-46b8-b4be-4f11172ee243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:05Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db11a8c3-9d70-4552-9461-78d4fddf98b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db11a8c3-9d70-4552-9461-78d4fddf98b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f274a883-b537-4a62-ae10-2e761898f294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f274a883-b537-4a62-ae10-2e761898f294) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0059232c-7d2f-46b8-b4be-4f11172ee243', 'volume_name': 'volume-0059232c-7d2f-46b8-b4be-4f11172ee243', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a34c22e-e655-4162-98a8-ce688609a184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a34c22e-e655-4162-98a8-ce688609a184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe651ea7-f15a-49f6-9313-a8084b35438a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Volume 0059232c-7d2f-46b8-b4be-4f11172ee243: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0059232c-7d2f-46b8-b4be-4f11172ee243', 'volume_size': 1} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Acquiring lock "cinder-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (3eae9d9c-78e5-431d-bc15-ca33b1830ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d9c39f-b1f1-4736-bb02-32efde32e308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86d9c39f-b1f1-4736-bb02-32efde32e308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548598292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fc032a-5014-44d6-b7b1-e1942d4dc510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:06Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256e5317-0059-4783-95d2-999a114c0cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (256e5317-0059-4783-95d2-999a114c0cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ba18cf-c537-49cd-975e-5fb1bb86df13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3ba18cf-c537-49cd-975e-5fb1bb86df13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36fc032a-5014-44d6-b7b1-e1942d4dc510', 'volume_name': 'volume-36fc032a-5014-44d6-b7b1-e1942d4dc510', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555dac61-b3a2-4bd6-9ce7-f810e2f4df44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555dac61-b3a2-4bd6-9ce7-f810e2f4df44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349812e8-9de6-46d5-bb18-0a2cfb5eed99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Volume 36fc032a-5014-44d6-b7b1-e1942d4dc510: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36fc032a-5014-44d6-b7b1-e1942d4dc510', 'volume_size': 1} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Lock "cinder-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Acquiring lock "cinder-quobyte-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Lock "cinder-quobyte-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87e7852-7ff6-43ca-8be5-a60fd1295253]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:06 devstack sudo[87137]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 1073741824" returned: 0 in 0.958s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:06 devstack sudo[87173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 Apr 13 11:03:06 devstack sudo[87173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:06 devstack sudo[87172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 Apr 13 11:03:06 devstack sudo[87172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (c3197759-627f-4bda-9e81-d0cf818efee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ac211f-50b3-418a-8102-2237b6d71727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35ac211f-50b3-418a-8102-2237b6d71727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-96688881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28feb83b-a75f-45ee-9c71-c1d858f67baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:06Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f089b8-bdaf-4f4b-a63e-88f3d7ce5c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26f089b8-bdaf-4f4b-a63e-88f3d7ce5c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ab6068-6c25-4be2-9f4e-7b8e8ba4c624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04ab6068-6c25-4be2-9f4e-7b8e8ba4c624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28feb83b-a75f-45ee-9c71-c1d858f67baf', 'volume_name': 'volume-28feb83b-a75f-45ee-9c71-c1d858f67baf', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52394f0-0485-4537-91f6-b31a3af3eab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d52394f0-0485-4537-91f6-b31a3af3eab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4326945b-2945-4cca-9810-890f1cab393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Volume 28feb83b-a75f-45ee-9c71-c1d858f67baf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28feb83b-a75f-45ee-9c71-c1d858f67baf', 'volume_size': 1} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:06 devstack sudo[87147]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.040s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:06 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Deleted volume successfully. Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3d5b5a8c-1333-454b-a52f-dafb44507be3 tempest-VolumesActionsTest-479573529 None] Lock "cinder-8627bebd-2fe9-4e3d-8c87-983fca4ccf44-delete_volume" released by "delete_volume" :: held 2.886s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (e4108d25-dc43-49c1-9b00-eeab7a2abba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96322df-4a44-403e-abf1-6474e2aa705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96322df-4a44-403e-abf1-6474e2aa705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31320249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f140d77e-8079-479b-8d70-0f248867c8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:07Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538a377c-49ee-479f-92b8-a97873828816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (538a377c-49ee-479f-92b8-a97873828816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2268989f-587d-4c01-a9a7-bc1d434d0a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2268989f-587d-4c01-a9a7-bc1d434d0a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f140d77e-8079-479b-8d70-0f248867c8ef', 'volume_name': 'volume-f140d77e-8079-479b-8d70-0f248867c8ef', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29210533-351d-473c-9316-a24b3c67226f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29210533-351d-473c-9316-a24b3c67226f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d494a1-7d52-4f1e-8b3d-31c883c21ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Volume f140d77e-8079-479b-8d70-0f248867c8ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f140d77e-8079-479b-8d70-0f248867c8ef', 'volume_size': 1} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:06 devstack sudo[87173]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (7b0e5c23-b565-49fd-84ef-51f04cad10b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232e2b77-20bb-464e-bcdc-f78448e708b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack sudo[87172]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (232e2b77-20bb-464e-bcdc-f78448e708b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-145693945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d6bb28-02b0-4343-bf27-84216205bc58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:07Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034248de-4c13-4697-8a8c-459c422d5182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (034248de-4c13-4697-8a8c-459c422d5182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134595c2-3e7a-49b7-a6d0-abe213b964e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (134595c2-3e7a-49b7-a6d0-abe213b964e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1d6bb28-02b0-4343-bf27-84216205bc58', 'volume_name': 'volume-c1d6bb28-02b0-4343-bf27-84216205bc58', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05425c01-85de-4a77-bd8a-da90c9c14ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05425c01-85de-4a77-bd8a-da90c9c14ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db41f248-796c-4dfe-867b-39b4c026f56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Volume c1d6bb28-02b0-4343-bf27-84216205bc58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1d6bb28-02b0-4343-bf27-84216205bc58', 'volume_size': 1} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6" returned: 0 in 0.664s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7" returned: 0 in 0.751s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] <== create_volume: return (1673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.676s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.247s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1257037682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0059232c-7d2f-46b8-b4be-4f11172ee243,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:05Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Creating volume 0059232c-7d2f-46b8-b4be-4f11172ee243 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:06 devstack sudo[87183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7 Apr 13 11:03:06 devstack sudo[87183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:06 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27f18f59-4345-4fd4-befb-bf199f3b13a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135d87bc-cd09-4b21-ad55-3128b01ee197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:06 devstack sudo[87185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 1073741824 Apr 13 11:03:06 devstack sudo[87185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Volume volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 (4540105b-522c-4f8b-a86d-8dfc60ef4fe6): created successfully Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (135d87bc-cd09-4b21-ad55-3128b01ee197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (cfe3048f-f290-4d0c-a318-ea9bbd27bb30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:06 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-51d05393-3b70-4d5c-98fb-617d45dce2d7 tempest-CreateVolumesFromImageTest-538257058 None] Created volume successfully. Apr 13 11:03:07 devstack sudo[87183]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7" returned: 0 in 0.506s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Lock "cinder-quobyte-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7" released by "delete_volume" :: held 1.286s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Created reservations ['c42a58f4-d1ff-436c-b67d-b5ba57d9a208', 'a03e2c56-7dc3-4490-befe-e9e5831ecd13', 'd90c4857-aa9c-4791-b9c4-181af4d50593', '5a8352a0-04de-4030-937d-5fb27e6c3ec9'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:07 devstack sudo[87192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:07 devstack sudo[87192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:07 devstack sudo[87185]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 1073741824" returned: 0 in 0.621s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:07 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 Apr 13 11:03:07 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:07 devstack sudo[87192]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.454s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:07 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Deleted volume successfully. Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ebb1990a-1c7a-4952-8cb6-21f06868c286 tempest-VolumesCloneNegativeTest-1693845606 None] Lock "cinder-974f881e-1d7c-4ae7-bde5-ebe1f5b015d7-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:07 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243" returned: 0 in 0.425s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.907s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1548598292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36fc032a-5014-44d6-b7b1-e1942d4dc510,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:06Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Creating volume 36fc032a-5014-44d6-b7b1-e1942d4dc510 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:07 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe651ea7-f15a-49f6-9313-a8084b35438a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0059232c-7d2f-46b8-b4be-4f11172ee243', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee02f47c-96dc-4ea9-b794-eb527c401de9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:07 devstack sudo[87198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 1073741824 Apr 13 11:03:07 devstack sudo[87198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:07 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Volume volume-0059232c-7d2f-46b8-b4be-4f11172ee243 (0059232c-7d2f-46b8-b4be-4f11172ee243): created successfully Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee02f47c-96dc-4ea9-b794-eb527c401de9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (445d5457-5b2f-4665-938d-2238c42b1558) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:07 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6998f5b6-236e-4a59-99bd-35e26985fcdd tempest-CreateVolumesFromImageTest-538257058 None] Created volume successfully. Apr 13 11:03:08 devstack sudo[87198]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 1073741824" returned: 0 in 0.592s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:08 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 Apr 13 11:03:08 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:09 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510" returned: 0 in 0.496s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.117s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.726s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-96688881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28feb83b-a75f-45ee-9c71-c1d858f67baf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:06Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Creating volume 28feb83b-a75f-45ee-9c71-c1d858f67baf {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:09 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (349812e8-9de6-46d5-bb18-0a2cfb5eed99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36fc032a-5014-44d6-b7b1-e1942d4dc510', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be7ebb7-ac40-47f4-9699-d99076fd0504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:09 devstack sudo[87206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf 1073741824 Apr 13 11:03:09 devstack sudo[87206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:09 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Volume volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 (36fc032a-5014-44d6-b7b1-e1942d4dc510): created successfully Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7be7ebb7-ac40-47f4-9699-d99076fd0504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (3eae9d9c-78e5-431d-bc15-ca33b1830ad8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:09 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-12a054a9-f153-454a-86e7-a72ca3b8092d tempest-CreateVolumesFromImageTest-538257058 None] Created volume successfully. Apr 13 11:03:09 devstack sudo[87206]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf 1073741824" returned: 0 in 0.575s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:09 devstack sudo[87212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf Apr 13 11:03:09 devstack sudo[87212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:10 devstack sudo[87212]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf" returned: 0 in 0.516s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.455s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-31320249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f140d77e-8079-479b-8d70-0f248867c8ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f78344fbfa64ddf8dfb80bea63b2158',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:07Z,use_quota=True,user_id='3f41fcacbc3e4a81b5f10524bbfe5c73',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Creating volume f140d77e-8079-479b-8d70-0f248867c8ef {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:10 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4326945b-2945-4cca-9810-890f1cab393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28feb83b-a75f-45ee-9c71-c1d858f67baf', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c637ec4d-e629-4939-a726-e4bbf33e7dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:10 devstack sudo[87215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef 1073741824 Apr 13 11:03:10 devstack sudo[87215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:10 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Volume volume-28feb83b-a75f-45ee-9c71-c1d858f67baf (28feb83b-a75f-45ee-9c71-c1d858f67baf): created successfully Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c637ec4d-e629-4939-a726-e4bbf33e7dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (c3197759-627f-4bda-9e81-d0cf818efee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:10 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e7f88124-7ce2-4ff3-9d35-0be7ff009bf2 tempest-CreateVolumesFromImageTest-538257058 None] Created volume successfully. Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Flow 'volume_create_manager' (ce452677-a153-4e96-a7f9-ce0402224337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3e5d1e-4040-4c0e-b4df-ad71a410a09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c3e5d1e-4040-4c0e-b4df-ad71a410a09b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-252120813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf65a6a4-e8bb-47ff-9265-b977d8abbfa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf34b52153445ea7a4948a7625edb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:10Z,use_quota=True,user_id='7b59cc3878a5449ea5ac8242d996f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badc626c-e0d1-47b1-9a1d-4be4c25be0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (badc626c-e0d1-47b1-9a1d-4be4c25be0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991697f1-19b7-459c-b275-3ace1b9538ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991697f1-19b7-459c-b275-3ace1b9538ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf65a6a4-e8bb-47ff-9265-b977d8abbfa5', 'volume_name': 'volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240d5fec-30ae-48a2-a93b-76995585e0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (240d5fec-30ae-48a2-a93b-76995585e0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45aff1a6-09eb-4ec9-ac3a-67c67329a0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:10 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Volume cf65a6a4-e8bb-47ff-9265-b977d8abbfa5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5', 'volume_size': 1} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:10 devstack sudo[87215]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef 1073741824" returned: 0 in 0.558s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:10 devstack sudo[87220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef Apr 13 11:03:10 devstack sudo[87220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:11 devstack sudo[87220]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.416s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-145693945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1d6bb28-02b0-4343-bf27-84216205bc58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ad3c62b6594994950f20ea96b598c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:07Z,use_quota=True,user_id='45757ed3addb4e1189069a03577e2b10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Creating volume c1d6bb28-02b0-4343-bf27-84216205bc58 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:11 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d494a1-7d52-4f1e-8b3d-31c883c21ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f140d77e-8079-479b-8d70-0f248867c8ef', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64682100-eb06-4b43-9825-1a6254a9dca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:11 devstack sudo[87223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 1073741824 Apr 13 11:03:11 devstack sudo[87223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:11 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Volume volume-f140d77e-8079-479b-8d70-0f248867c8ef (f140d77e-8079-479b-8d70-0f248867c8ef): created successfully Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64682100-eb06-4b43-9825-1a6254a9dca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Flow 'volume_create_manager' (e4108d25-dc43-49c1-9b00-eeab7a2abba9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-43ae2407-7398-4058-90d4-c067470d1db0 tempest-VolumesActionsTest-1635315142 None] Created volume successfully. Apr 13 11:03:11 devstack sudo[87223]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 1073741824" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:11 devstack sudo[87229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 Apr 13 11:03:11 devstack sudo[87229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:12 devstack sudo[87229]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58" returned: 0 in 0.484s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.815s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-252120813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf65a6a4-e8bb-47ff-9265-b977d8abbfa5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf34b52153445ea7a4948a7625edb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:10Z,use_quota=True,user_id='7b59cc3878a5449ea5ac8242d996f26d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Creating volume cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:12 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db41f248-796c-4dfe-867b-39b4c026f56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1d6bb28-02b0-4343-bf27-84216205bc58', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17f9c88-fcd5-4e00-8cfc-b8fa9c49afdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:12 devstack sudo[87233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 1073741824 Apr 13 11:03:12 devstack sudo[87233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:12 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Volume volume-c1d6bb28-02b0-4343-bf27-84216205bc58 (c1d6bb28-02b0-4343-bf27-84216205bc58): created successfully Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c17f9c88-fcd5-4e00-8cfc-b8fa9c49afdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Flow 'volume_create_manager' (7b0e5c23-b565-49fd-84ef-51f04cad10b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-124c07ef-feb5-43c9-9705-1330793a9b8a tempest-CreateVolumesFromImageTest-538257058 None] Created volume successfully. Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "cinder-f140d77e-8079-479b-8d70-0f248867c8ef-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Lock "cinder-f140d77e-8079-479b-8d70-0f248867c8ef-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "cinder-quobyte-f140d77e-8079-479b-8d70-0f248867c8ef" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Lock "cinder-quobyte-f140d77e-8079-479b-8d70-0f248867c8ef" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d438c7fb-b79f-41da-bf3e-b9cc8f6015ca]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:12 devstack sudo[87235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef Apr 13 11:03:12 devstack sudo[87235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:12 devstack sudo[87233]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 1073741824" returned: 0 in 0.660s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:13 devstack sudo[87243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 Apr 13 11:03:13 devstack sudo[87243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:13 devstack sudo[87235]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef" returned: 0 in 0.625s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:13 devstack sudo[87245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef Apr 13 11:03:13 devstack sudo[87245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-c1d6bb28-02b0-4343-bf27-84216205bc58-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-c1d6bb28-02b0-4343-bf27-84216205bc58-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-quobyte-c1d6bb28-02b0-4343-bf27-84216205bc58" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-c1d6bb28-02b0-4343-bf27-84216205bc58" acquired by "delete_volume" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b81182-87f3-4ad0-a048-f414f812e6af]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:13 devstack sudo[87247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 Apr 13 11:03:13 devstack sudo[87247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:13 devstack sudo[87243]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5" returned: 0 in 0.717s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] <== create_volume: return (1406ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45aff1a6-09eb-4ec9-ac3a-67c67329a0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e9cac6-588a-4fd4-97c9-1ed5d14af21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:13 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Volume volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 (cf65a6a4-e8bb-47ff-9265-b977d8abbfa5): created successfully Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e9cac6-588a-4fd4-97c9-1ed5d14af21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Flow 'volume_create_manager' (ce452677-a153-4e96-a7f9-ce0402224337) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:13 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-cdfed9c8-d3b9-4b73-a312-6c06c95cc850 tempest-VolumesNegativeTest-1182556483 None] Created volume successfully. Apr 13 11:03:13 devstack sudo[87245]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-f140d77e-8079-479b-8d70-0f248867c8ef" returned: 0 in 0.715s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Lock "cinder-quobyte-f140d77e-8079-479b-8d70-0f248867c8ef" released by "delete_volume" :: held 1.367s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:13 devstack sudo[87247]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58" returned: 0 in 0.632s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Created reservations ['53a28df3-c5d3-43aa-80f1-3d1bf4146f41', '34cb9bb9-4807-4a9e-8d61-7454a756b8d1', 'e7dc3408-e754-41ed-b1b4-25d8d7d8883c', '6a62ecd2-a78e-4220-9e7c-49aeb2e69987'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:13 devstack sudo[87255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58 Apr 13 11:03:13 devstack sudo[87255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:13 devstack sudo[87257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:13 devstack sudo[87257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:14 devstack sudo[87257]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.532s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:14 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Deleted volume successfully. Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3fc6cad7-6bb2-4748-9279-42a0e6cb8438 tempest-VolumesActionsTest-1635315142 None] Lock "cinder-f140d77e-8079-479b-8d70-0f248867c8ef-delete_volume" released by "delete_volume" :: held 2.075s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:14 devstack sudo[87255]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c1d6bb28-02b0-4343-bf27-84216205bc58" returned: 0 in 0.650s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-c1d6bb28-02b0-4343-bf27-84216205bc58" released by "delete_volume" :: held 1.308s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Created reservations ['2bf429c2-ec8a-420d-a225-d36cf951e6e9', 'c190331d-38ba-4912-9c90-0954af495ba7', '9e8a8f44-75c1-43d4-9838-4b0793f46e6e', '509f8888-9409-4ad5-bdb0-c6fb661ed0eb'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:14 devstack sudo[87261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:14 devstack sudo[87261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:15 devstack sudo[87261]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.569s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:15 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Deleted volume successfully. Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5128a55f-4a43-44ca-8723-ec65baa22a0e tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-c1d6bb28-02b0-4343-bf27-84216205bc58-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-28feb83b-a75f-45ee-9c71-c1d858f67baf-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-28feb83b-a75f-45ee-9c71-c1d858f67baf-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-quobyte-28feb83b-a75f-45ee-9c71-c1d858f67baf" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-28feb83b-a75f-45ee-9c71-c1d858f67baf" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc4d668-7dff-458a-8e93-652290cac155]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:15 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf Apr 13 11:03:15 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e30ff7aa-8ea6-4b79-b4d5-0009b5f2fa95 tempest-GroupSnapshotsTest-678215182 None] Group tempest-GroupSnapshotsTest-Group-409824901: creating Apr 13 11:03:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e30ff7aa-8ea6-4b79-b4d5-0009b5f2fa95 tempest-GroupSnapshotsTest-678215182 None] Group tempest-GroupSnapshotsTest-Group-409824901: created successfully Apr 13 11:03:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e30ff7aa-8ea6-4b79-b4d5-0009b5f2fa95 tempest-GroupSnapshotsTest-678215182 None] Create group completed successfully. Apr 13 11:03:16 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf" returned: 0 in 0.643s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:16 devstack sudo[87276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf Apr 13 11:03:16 devstack sudo[87276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:16 devstack sudo[87276]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-28feb83b-a75f-45ee-9c71-c1d858f67baf" returned: 0 in 0.451s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-28feb83b-a75f-45ee-9c71-c1d858f67baf" released by "delete_volume" :: held 1.128s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Created reservations ['d8af4b47-91a7-4265-bbec-a23643b708d6', '9d8d2404-3eca-4e30-9f50-23232ea3fd77', '902489cb-b372-4694-a597-d6960c44729a', 'ac2aa66e-f93f-443b-bc3e-431027e9f70b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:16 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:16 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:17 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.426s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:17 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Deleted volume successfully. Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d3727cb1-d157-4ec5-a751-1ef51193795a tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-28feb83b-a75f-45ee-9c71-c1d858f67baf-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Flow 'volume_create_manager' (aa8b343f-beb3-4b50-8f3e-a0b816fe07f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46729957-6062-416a-b446-c75d60733908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46729957-6062-416a-b446-c75d60733908) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-503181596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=366b302b-fc25-4a45-833f-27e840270d13,host='devstack@QuobyteHD#QuobyteHD',id=546718b9-5e13-40d7-a0d9-c6c92b216945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418d3141293d4cec8dd6dc4f342dc574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:17Z,use_quota=True,user_id='896e78490c70419680a741c693276de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49487217-c967-4065-a93c-14c512e9b6ca),volume_type_id=49487217-c967-4065-a93c-14c512e9b6ca)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bfe11a-1354-4571-85a0-ab67120f6c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85bfe11a-1354-4571-85a0-ab67120f6c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a3020d-a669-4480-ba9d-53852de3aecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a3020d-a669-4480-ba9d-53852de3aecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546718b9-5e13-40d7-a0d9-c6c92b216945', 'volume_name': 'volume-546718b9-5e13-40d7-a0d9-c6c92b216945', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b53d4d-0b7f-468a-ac63-31773cfbed52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b53d4d-0b7f-468a-ac63-31773cfbed52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d3df4e-55dc-4601-bac5-e928c1491375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:17 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Volume 546718b9-5e13-40d7-a0d9-c6c92b216945: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546718b9-5e13-40d7-a0d9-c6c92b216945', 'volume_size': 1} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=366b302b-fc25-4a45-833f-27e840270d13,created_at=2026-04-13T09:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-503181596',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=366b302b-fc25-4a45-833f-27e840270d13,host='devstack@QuobyteHD#QuobyteHD',id=546718b9-5e13-40d7-a0d9-c6c92b216945,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418d3141293d4cec8dd6dc4f342dc574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:17Z,use_quota=True,user_id='896e78490c70419680a741c693276de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(49487217-c967-4065-a93c-14c512e9b6ca),volume_type_id=49487217-c967-4065-a93c-14c512e9b6ca)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Creating volume 546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:17 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-36fc032a-5014-44d6-b7b1-e1942d4dc510-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-36fc032a-5014-44d6-b7b1-e1942d4dc510-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:17 devstack sudo[87283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 1073741824 Apr 13 11:03:17 devstack sudo[87283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-quobyte-36fc032a-5014-44d6-b7b1-e1942d4dc510" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-36fc032a-5014-44d6-b7b1-e1942d4dc510" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[99053b14-5497-4034-b9b3-bac486f298e7]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:17 devstack sudo[87285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 Apr 13 11:03:17 devstack sudo[87285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:18 devstack sudo[87283]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 1073741824" returned: 0 in 0.554s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:18 devstack sudo[87293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 Apr 13 11:03:18 devstack sudo[87293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:18 devstack sudo[87285]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510" returned: 0 in 0.564s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:18 devstack sudo[87295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510 Apr 13 11:03:18 devstack sudo[87295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:18 devstack sudo[87293]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945" returned: 0 in 0.528s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d3df4e-55dc-4601-bac5-e928c1491375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546718b9-5e13-40d7-a0d9-c6c92b216945', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59eaf35e-9126-4655-82c3-adbc59d8b01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:18 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Volume volume-546718b9-5e13-40d7-a0d9-c6c92b216945 (546718b9-5e13-40d7-a0d9-c6c92b216945): created successfully Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59eaf35e-9126-4655-82c3-adbc59d8b01f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Flow 'volume_create_manager' (aa8b343f-beb3-4b50-8f3e-a0b816fe07f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9e581c7d-445c-4eb1-99c6-b034d6b3d5fd tempest-GroupSnapshotsTest-678215182 None] Created volume successfully. Apr 13 11:03:18 devstack sudo[87295]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-36fc032a-5014-44d6-b7b1-e1942d4dc510" returned: 0 in 0.537s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-36fc032a-5014-44d6-b7b1-e1942d4dc510" released by "delete_volume" :: held 1.123s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Created reservations ['2b48d172-1784-4df2-88ac-b87f3664dffd', '068d0734-3b0b-482e-9828-324bac5618dd', 'e6846ca4-3e7c-4c27-a751-568784fe603e', '7d2d21fa-eb18-441a-8580-a79b65db1154'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:18 devstack sudo[87301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:18 devstack sudo[87301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:19 devstack sudo[87301]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.440s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:19 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Deleted volume successfully. Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8a1b1c21-2b41-4a5d-ad02-0fcdd582acfe tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-36fc032a-5014-44d6-b7b1-e1942d4dc510-delete_volume" released by "delete_volume" :: held 1.697s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-0059232c-7d2f-46b8-b4be-4f11172ee243-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-0059232c-7d2f-46b8-b4be-4f11172ee243-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-quobyte-0059232c-7d2f-46b8-b4be-4f11172ee243" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-0059232c-7d2f-46b8-b4be-4f11172ee243" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98465a7-7e99-4fa9-9d10-7dc6b2a7dda2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:19 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] GroupSnapshot 7e0205cf-67a4-47c2-a92d-57a4abaeaf8a: creating. Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Group snapshot 7e0205cf-67a4-47c2-a92d-57a4abaeaf8a: creating. {{(pid=82656) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Creating offline snapshot 78ffa11b-e9a5-472a-a4eb-8136922ac154 of volume 546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce58bc2-bfc6-41da-8ede-be6ebe9ea206]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:20 devstack sudo[87304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 Apr 13 11:03:20 devstack sudo[87304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:20 devstack sudo[87306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 Apr 13 11:03:20 devstack sudo[87306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:20 devstack sudo[87304]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243" returned: 0 in 0.613s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:20 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243 Apr 13 11:03:20 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:20 devstack sudo[87306]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945" returned: 0 in 0.717s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:20 devstack sudo[87317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 1G Apr 13 11:03:20 devstack sudo[87317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:21 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0059232c-7d2f-46b8-b4be-4f11172ee243" returned: 0 in 0.564s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-0059232c-7d2f-46b8-b4be-4f11172ee243" released by "delete_volume" :: held 1.227s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Created reservations ['a9a9a9f6-80aa-42e3-acc0-05dcc3734b72', 'ae6a88bb-532f-47bc-bbb7-77f7223b1a43', 'ebde4ff8-9514-4b3d-9ceb-e3ab941122cc', 'a32c9e4d-5548-40c0-b6bc-15e93326fc6b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:21 devstack sudo[87329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:21 devstack sudo[87329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:21 devstack sudo[87317]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 1G" returned: 0 in 0.685s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-546718b9-5e13-40d7-a0d9-c6c92b216945 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:21 devstack sudo[87331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-546718b9-5e13-40d7-a0d9-c6c92b216945 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 Apr 13 11:03:21 devstack sudo[87331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:21 devstack sudo[87329]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.604s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:21 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Deleted volume successfully. Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2ca33da5-c1cb-4c37-abab-033f1c7b2f14 tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-0059232c-7d2f-46b8-b4be-4f11172ee243-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:21 devstack sudo[87331]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-546718b9-5e13-40d7-a0d9-c6c92b216945 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:21 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:03:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:21 devstack sudo[87349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 Apr 13 11:03:21 devstack sudo[87349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-4540105b-522c-4f8b-a86d-8dfc60ef4fe6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-4540105b-522c-4f8b-a86d-8dfc60ef4fe6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "cinder-quobyte-4540105b-522c-4f8b-a86d-8dfc60ef4fe6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-4540105b-522c-4f8b-a86d-8dfc60ef4fe6" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[914a4178-110e-4a61-9f65-0a362b06f4fa]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:22 devstack sudo[87354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 Apr 13 11:03:22 devstack sudo[87354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:22 devstack sudo[87349]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154" returned: 0 in 0.523s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:22 devstack sudo[87359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.info Apr 13 11:03:22 devstack sudo[87359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:22 devstack sudo[87354]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6" returned: 0 in 0.595s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:22 devstack sudo[87364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6 Apr 13 11:03:22 devstack sudo[87364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Flow 'volume_create_manager' (0b5c370b-11ae-4fc8-9fc2-f57b7e575f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dbd03a-d0f2-44fa-ad42-bc18157ddab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72dbd03a-d0f2-44fa-ad42-bc18157ddab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1366308870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db35b41-9db1-4f8b-895c-9d3cee7366db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54928653502040059d180b32f4ca3a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:23Z,use_quota=True,user_id='cfca801e97e646a4ace0bf4ca09c10a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb2ec9b-c0fe-4741-81a0-9c8d652bdac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7fb2ec9b-c0fe-4741-81a0-9c8d652bdac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0293c614-1d9f-4939-bed3-535f3a6506ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0293c614-1d9f-4939-bed3-535f3a6506ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8db35b41-9db1-4f8b-895c-9d3cee7366db', 'volume_name': 'volume-8db35b41-9db1-4f8b-895c-9d3cee7366db', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e5fd55-217a-4dbe-bbd3-08deb0c0848a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e5fd55-217a-4dbe-bbd3-08deb0c0848a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab4376d-b436-4437-be96-1507ae227d18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:22 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Volume 8db35b41-9db1-4f8b-895c-9d3cee7366db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8db35b41-9db1-4f8b-895c-9d3cee7366db', 'volume_size': 1} Apr 13 11:03:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:23 devstack sudo[87359]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.info" returned: 0 in 0.545s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:23 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:23 devstack sudo[87367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.info Apr 13 11:03:23 devstack sudo[87367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:23 devstack sudo[87364]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4540105b-522c-4f8b-a86d-8dfc60ef4fe6" returned: 0 in 0.473s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-quobyte-4540105b-522c-4f8b-a86d-8dfc60ef4fe6" released by "delete_volume" :: held 1.090s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Created reservations ['43d79e39-06de-463f-ac64-59c374c5e981', '3030253d-c54a-4bc9-ad75-b4d160ecbe02', '1a9b950c-18a9-4cff-9c3d-5eb8b71b75a5', 'a78956fb-8ca8-44bd-8b32-04b8e9646c96'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:23 devstack sudo[87370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:23 devstack sudo[87370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:23 devstack sudo[87367]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.info" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.548s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1366308870',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8db35b41-9db1-4f8b-895c-9d3cee7366db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54928653502040059d180b32f4ca3a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:23Z,use_quota=True,user_id='cfca801e97e646a4ace0bf4ca09c10a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Creating volume 8db35b41-9db1-4f8b-895c-9d3cee7366db {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:23 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:23 devstack sudo[87373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db 1073741824 Apr 13 11:03:23 devstack sudo[87373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ad200b0e-6013-4ecb-a3bb-4bca65b50edd tempest-GroupSnapshotsTest-678215182 None] group_snapshot 7e0205cf-67a4-47c2-a92d-57a4abaeaf8a: created successfully Apr 13 11:03:23 devstack sudo[87370]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.427s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Deleted volume successfully. Apr 13 11:03:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d916c84b-da70-462f-aa17-9e74b33408ab tempest-CreateVolumesFromImageTest-538257058 None] Lock "cinder-4540105b-522c-4f8b-a86d-8dfc60ef4fe6-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:24 devstack sudo[87373]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db 1073741824" returned: 0 in 0.566s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:24 devstack sudo[87379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db Apr 13 11:03:24 devstack sudo[87379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:24 devstack sudo[87379]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db" returned: 0 in 0.478s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ab4376d-b436-4437-be96-1507ae227d18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8db35b41-9db1-4f8b-895c-9d3cee7366db', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fce2933-5048-480e-87c9-05fcb2ce95a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:24 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Volume volume-8db35b41-9db1-4f8b-895c-9d3cee7366db (8db35b41-9db1-4f8b-895c-9d3cee7366db): created successfully Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fce2933-5048-480e-87c9-05fcb2ce95a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:24 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Flow 'volume_create_manager' (0b5c370b-11ae-4fc8-9fc2-f57b7e575f71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:24 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b8d506d4-c926-4530-a29b-e351069a9754 tempest-VolumesListAdminTestJSON-937817984 None] Created volume successfully. Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-78ffa11b-e9a5-472a-a4eb-8136922ac154-66f27c65-af74-41a3-9e02-ca7a80e15402" by "_create_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-78ffa11b-e9a5-472a-a4eb-8136922ac154-66f27c65-af74-41a3-9e02-ca7a80e15402" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Creating volume 66f27c65-af74-41a3-9e02-ca7a80e15402 from snapshot 78ffa11b-e9a5-472a-a4eb-8136922ac154 {{(pid=82656) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-66f27c65-af74-41a3-9e02-ca7a80e15402" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-66f27c65-af74-41a3-9e02-ca7a80e15402" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] snapshot: 78ffa11b-e9a5-472a-a4eb-8136922ac154, volume: 66f27c65-af74-41a3-9e02-ca7a80e15402, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[487769ff-961f-439b-b99c-d8158b58c049]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:25 devstack sudo[87385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 Apr 13 11:03:25 devstack sudo[87385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Flow 'volume_create_manager' (696b1332-fa95-4c7a-bd5c-48bb806deb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c588c22-a463-495a-a627-162c46252976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c588c22-a463-495a-a627-162c46252976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1797757499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745f4eee-063c-4f84-b370-24ee63db437b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54928653502040059d180b32f4ca3a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:25Z,use_quota=True,user_id='cfca801e97e646a4ace0bf4ca09c10a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acca9e22-b14a-426a-8480-74e3f94500ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (acca9e22-b14a-426a-8480-74e3f94500ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf9959f-c66e-4646-a3cf-527872f45732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf9959f-c66e-4646-a3cf-527872f45732) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '745f4eee-063c-4f84-b370-24ee63db437b', 'volume_name': 'volume-745f4eee-063c-4f84-b370-24ee63db437b', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eebc9b7-b8ec-4920-a9be-231b8a2db491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9eebc9b7-b8ec-4920-a9be-231b8a2db491) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aa7c12-5c49-4975-9d4f-ae3a7c836195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:25 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Volume 745f4eee-063c-4f84-b370-24ee63db437b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-745f4eee-063c-4f84-b370-24ee63db437b', 'volume_size': 1} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:25 devstack sudo[87385]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154" returned: 0 in 0.601s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-546718b9-5e13-40d7-a0d9-c6c92b216945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9add7df5-583f-4139-9a09-ae5b65d27774]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:25 devstack sudo[87390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 Apr 13 11:03:25 devstack sudo[87390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (a1eceabc-9c66-4f15-bc22-19c03c9dd19b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175aa499-e14c-4b19-9e0f-1a0d8853aaf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (175aa499-e14c-4b19-9e0f-1a0d8853aaf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-329420873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d23f45d-fdd6-4a8c-9d87-6994986a01e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:26Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b66692-6f5d-4e12-ac9a-e4341702fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4b66692-6f5d-4e12-ac9a-e4341702fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22853710-babf-40cd-936d-53eb8f65fbbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22853710-babf-40cd-936d-53eb8f65fbbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d23f45d-fdd6-4a8c-9d87-6994986a01e6', 'volume_name': 'volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e39ebd44-74a3-47da-9843-456f2d141767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e39ebd44-74a3-47da-9843-456f2d141767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95e3552-aded-49c4-bf58-40905f84881c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:26 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume 7d23f45d-fdd6-4a8c-9d87-6994986a01e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6', 'volume_size': 1} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:26 devstack sudo[87390]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945" returned: 0 in 0.527s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:03:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:26 devstack sudo[87395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 Apr 13 11:03:26 devstack sudo[87395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:29 devstack sudo[87395]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402" returned: 0 in 2.965s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[29ba7655-49ed-4067-b53c-a8813eced2d2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:29 devstack sudo[87437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 Apr 13 11:03:29 devstack sudo[87437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:29 devstack sudo[87437]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945" returned: 0 in 0.654s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:29 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945, size 1024.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:03:29 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Converted 1024.00 MB image at 345.18 MB/s Apr 13 11:03:29 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:03:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:29 devstack sudo[87443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 Apr 13 11:03:29 devstack sudo[87443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:30 devstack sudo[87443]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402" returned: 0 in 0.438s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-66f27c65-af74-41a3-9e02-ca7a80e15402" released by "_copy_volume_from_snapshot" :: held 5.250s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-78ffa11b-e9a5-472a-a4eb-8136922ac154-66f27c65-af74-41a3-9e02-ca7a80e15402" released by "_create_volume_from_snapshot" :: held 5.266s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.275s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.859s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1797757499',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=745f4eee-063c-4f84-b370-24ee63db437b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54928653502040059d180b32f4ca3a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:25Z,use_quota=True,user_id='cfca801e97e646a4ace0bf4ca09c10a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Creating volume 745f4eee-063c-4f84-b370-24ee63db437b {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:30 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:30 devstack sudo[87446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b 1073741824 Apr 13 11:03:30 devstack sudo[87446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:30 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-02cf4403-0a93-49fb-af42-a5c59b83c8f7 tempest-GroupSnapshotsTest-678215182 None] Create group from source-snapshot-7e0205cf-67a4-47c2-a92d-57a4abaeaf8a completed successfully. Apr 13 11:03:30 devstack sudo[87446]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b 1073741824" returned: 0 in 0.550s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:30 devstack sudo[87479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b Apr 13 11:03:30 devstack sudo[87479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-66f27c65-af74-41a3-9e02-ca7a80e15402" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-66f27c65-af74-41a3-9e02-ca7a80e15402" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b083346-0a44-4b87-9bba-61c90b097839]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:31 devstack sudo[87479]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b" returned: 0 in 0.479s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:31 devstack sudo[87482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] <== create_volume: return (1054ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.057s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:31 devstack sudo[87482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.335s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-329420873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d23f45d-fdd6-4a8c-9d87-6994986a01e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:26Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Creating volume 7d23f45d-fdd6-4a8c-9d87-6994986a01e6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:31 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25aa7c12-5c49-4975-9d4f-ae3a7c836195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-745f4eee-063c-4f84-b370-24ee63db437b', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edde78b0-6368-46e5-81c0-6b46e93ec051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:31 devstack sudo[87484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 1073741824 Apr 13 11:03:31 devstack sudo[87484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Volume volume-745f4eee-063c-4f84-b370-24ee63db437b (745f4eee-063c-4f84-b370-24ee63db437b): created successfully Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edde78b0-6368-46e5-81c0-6b46e93ec051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Flow 'volume_create_manager' (696b1332-fa95-4c7a-bd5c-48bb806deb42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:31 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f6da893a-a9b7-48ee-8617-110020b3008d tempest-VolumesListAdminTestJSON-937817984 None] Created volume successfully. Apr 13 11:03:31 devstack sudo[87482]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402" returned: 0 in 0.491s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:31 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402 Apr 13 11:03:31 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:31 devstack sudo[87484]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 1073741824" returned: 0 in 0.561s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:32 devstack sudo[87496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 Apr 13 11:03:32 devstack sudo[87496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:32 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-66f27c65-af74-41a3-9e02-ca7a80e15402" returned: 0 in 0.502s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-66f27c65-af74-41a3-9e02-ca7a80e15402" released by "delete_volume" :: held 1.029s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Created reservations ['f604fed2-71cf-44fe-bbde-61bbe84196d3'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Flow 'volume_create_manager' (9990248c-8328-42b1-a99a-226dce6991fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3caff088-980f-4d39-8462-2dbace740827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3caff088-980f-4d39-8462-2dbace740827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-609069452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6927c0f5-61c3-4da4-a6f2-fb12fa52182e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54928653502040059d180b32f4ca3a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:32Z,use_quota=True,user_id='cfca801e97e646a4ace0bf4ca09c10a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa19cc4-8e4d-489e-9088-7a1058bbb281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fa19cc4-8e4d-489e-9088-7a1058bbb281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f242a23d-71d8-4e45-acd4-3a5b2592d021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f242a23d-71d8-4e45-acd4-3a5b2592d021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6927c0f5-61c3-4da4-a6f2-fb12fa52182e', 'volume_name': 'volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172ba1ca-6057-43e0-a0ce-dd166bd0e64c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172ba1ca-6057-43e0-a0ce-dd166bd0e64c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9613d25c-3626-4809-a996-55f1c37efdc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:32 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Volume 6927c0f5-61c3-4da4-a6f2-fb12fa52182e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e', 'volume_size': 1} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:32 devstack cinder-volume[82656]: WARNING cinder.quota [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1108248422 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1108248422, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:03:32 devstack cinder-volume[82656]: WARNING cinder.quota [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1108248422 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1108248422, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Created reservations ['fc085060-7842-4f40-a38b-c578a9cf8802', 'f5cf74ef-b51e-4a87-9ee6-f9f47418a9a2', 'addd8429-fae5-4502-a0a1-bb78e1a53842', 'd20bf19b-3f6c-4022-8bc6-1e4f07a45d65'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:32 devstack sudo[87501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:32 devstack sudo[87501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:32 devstack sudo[87496]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" returned: 0 in 0.644s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] <== create_volume: return (1240ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.156s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-609069452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6927c0f5-61c3-4da4-a6f2-fb12fa52182e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54928653502040059d180b32f4ca3a31',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:32Z,use_quota=True,user_id='cfca801e97e646a4ace0bf4ca09c10a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Creating volume 6927c0f5-61c3-4da4-a6f2-fb12fa52182e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:32 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e95e3552-aded-49c4-bf58-40905f84881c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:32 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e 1073741824 Apr 13 11:03:32 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8080cc7-9a0a-4136-a536-c787af7b0185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:32 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 (7d23f45d-fdd6-4a8c-9d87-6994986a01e6): created successfully Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8080cc7-9a0a-4136-a536-c787af7b0185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (a1eceabc-9c66-4f15-bc22-19c03c9dd19b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:32 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-cb7c868c-e4e6-4584-97cb-1b96a98c41e3 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created volume successfully. Apr 13 11:03:33 devstack sudo[87501]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.469s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:33 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-29aae6a9-1c48-4640-bd26-b0769bdc254f tempest-GroupSnapshotsTest-678215182 None] Delete group completed successfully. Apr 13 11:03:33 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e 1073741824" returned: 0 in 0.538s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:33 devstack sudo[87509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e Apr 13 11:03:33 devstack sudo[87509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:33 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] group_snapshot 7e0205cf-67a4-47c2-a92d-57a4abaeaf8a: deleting Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] group_snapshot 7e0205cf-67a4-47c2-a92d-57a4abaeaf8a: deleting {{(pid=82656) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-546718b9-5e13-40d7-a0d9-c6c92b216945" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-546718b9-5e13-40d7-a0d9-c6c92b216945" acquired by "delete_snapshot" :: waited 0.035s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-78ffa11b-e9a5-472a-a4eb-8136922ac154" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-78ffa11b-e9a5-472a-a4eb-8136922ac154" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Deleting offline snapshot 78ffa11b-e9a5-472a-a4eb-8136922ac154 of volume 546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] snapshot_file for this snap is: volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c1d9fb-af9f-4186-a568-39f5ce85d9e5]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:33 devstack sudo[87509]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e" returned: 0 in 0.510s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.055s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:33 devstack sudo[87512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 Apr 13 11:03:33 devstack sudo[87512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9613d25c-3626-4809-a996-55f1c37efdc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7f33dc-64c6-4cd0-ba7b-57352e65cd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Creating offline snapshot 149e9393-9b58-4324-9756-e6e44e1a4e37 of volume 7d23f45d-fdd6-4a8c-9d87-6994986a01e6 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:03:33 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Volume volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e (6927c0f5-61c3-4da4-a6f2-fb12fa52182e): created successfully Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7f33dc-64c6-4cd0-ba7b-57352e65cd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Flow 'volume_create_manager' (9990248c-8328-42b1-a99a-226dce6991fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc237321-2f18-4af8-b63c-fa63c2475cfe]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:33 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2a036575-2cce-4fa2-b97b-017f9cbbe295 tempest-VolumesListAdminTestJSON-937817984 None] Created volume successfully. Apr 13 11:03:33 devstack sudo[87514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 Apr 13 11:03:33 devstack sudo[87514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:34 devstack sudo[87512]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154" returned: 0 in 0.526s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-546718b9-5e13-40d7-a0d9-c6c92b216945(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3612d8e-2132-4264-8103-6d9acbaec1f6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:34 devstack sudo[87522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 Apr 13 11:03:34 devstack sudo[87522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:34 devstack sudo[87514]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" returned: 0 in 0.526s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:34 devstack sudo[87524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 1G Apr 13 11:03:34 devstack sudo[87524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:34 devstack sudo[87522]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945" returned: 0 in 0.536s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:34 devstack sudo[87532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 Apr 13 11:03:34 devstack sudo[87532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:34 devstack sudo[87524]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Flow 'volume_create_manager' (c15e29d8-13f2-440f-8e44-763b3b707cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2f29bf-8132-44c6-89c1-a991b377e428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e2f29bf-8132-44c6-89c1-a991b377e428) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fb2e68-2fbd-43c1-9750-a9cd998b17a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd15114f2574b73810c636390cc8476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:35Z,use_quota=True,user_id='de9ad708cdfc475a9b5dfdc35a894150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85349df-c36c-4280-b8e8-af9885558cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f85349df-c36c-4280-b8e8-af9885558cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0d867b-9dfb-4dfd-8cec-5ebbf7a7164b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0d867b-9dfb-4dfd-8cec-5ebbf7a7164b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02fb2e68-2fbd-43c1-9750-a9cd998b17a1', 'volume_name': 'volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd02bf5-5ecd-46c9-951b-5a1d55670d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd02bf5-5ecd-46c9-951b-5a1d55670d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b97cb84-5bb0-442d-89f3-2978812d2dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:34 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Volume 02fb2e68-2fbd-43c1-9750-a9cd998b17a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1', 'volume_size': 1} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 1G" returned: 0 in 0.623s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:34 devstack sudo[87534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 Apr 13 11:03:34 devstack sudo[87534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:35 devstack sudo[87532]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154" returned: 0 in 0.523s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:35 devstack sudo[87539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154 Apr 13 11:03:35 devstack sudo[87539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:35 devstack sudo[87534]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:35 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 is being set with open permissions: ugo+rw Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:35 devstack sudo[87544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 Apr 13 11:03:35 devstack sudo[87544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:35 devstack sudo[87539]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945.78ffa11b-e9a5-472a-a4eb-8136922ac154" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-78ffa11b-e9a5-472a-a4eb-8136922ac154" released by "_delete_snapshot" :: held 2.116s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-546718b9-5e13-40d7-a0d9-c6c92b216945" released by "delete_snapshot" :: held 2.131s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:35 devstack cinder-volume[82656]: WARNING cinder.quota [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1108248422 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1108248422, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] Created reservations ['9c494c71-b35b-45e4-8452-317e13aa39f0', '958415b2-2784-425a-a9aa-1a3e50209288', '67d83303-eee1-43bb-97cb-bc24d4f0f6b8', '32be1055-0918-45b3-958b-9690f4bb2754'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:35 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e76fbe88-0a82-4dc4-82f2-5e0f193645d4 tempest-GroupSnapshotsTest-678215182 None] group_snapshot 7e0205cf-67a4-47c2-a92d-57a4abaeaf8a: deleted successfully Apr 13 11:03:35 devstack sudo[87544]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37" returned: 0 in 0.451s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:35 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.info Apr 13 11:03:35 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:36 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.info" returned: 0 in 0.414s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:36 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.info is being set with open permissions: ugo+rw Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:36 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.info Apr 13 11:03:36 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:36 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.info" returned: 0 in 0.468s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.057s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.854s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fb2e68-2fbd-43c1-9750-a9cd998b17a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fd15114f2574b73810c636390cc8476',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:35Z,use_quota=True,user_id='de9ad708cdfc475a9b5dfdc35a894150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Creating volume 02fb2e68-2fbd-43c1-9750-a9cd998b17a1 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:36 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0736b4f9-2b12-4166-8ac2-ac7c216a6a14 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Create snapshot completed successfully Apr 13 11:03:36 devstack sudo[87554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 1073741824 Apr 13 11:03:36 devstack sudo[87554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-546718b9-5e13-40d7-a0d9-c6c92b216945" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-546718b9-5e13-40d7-a0d9-c6c92b216945" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:37 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04f48dc-59d4-4b47-9b1e-f75b6cb449ca]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:37 devstack sudo[87556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 Apr 13 11:03:37 devstack sudo[87556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:37 devstack sudo[87554]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 1073741824" returned: 0 in 0.642s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:37 devstack sudo[87564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 Apr 13 11:03:37 devstack sudo[87564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:37 devstack sudo[87556]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945" returned: 0 in 0.566s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:37 devstack sudo[87566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945 Apr 13 11:03:37 devstack sudo[87566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:38 devstack sudo[87564]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1" returned: 0 in 0.566s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] <== create_volume: return (1249ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b97cb84-5bb0-442d-89f3-2978812d2dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dffd30e5-a6fb-4ed6-ac54-1c9d7354d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (87ffe413-611a-4e30-9fcc-5328cd50de5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5e6c9e-1c19-4e8c-a19a-8ef157a0c7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Volume volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 (02fb2e68-2fbd-43c1-9750-a9cd998b17a1): created successfully Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dffd30e5-a6fb-4ed6-ac54-1c9d7354d376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Flow 'volume_create_manager' (c15e29d8-13f2-440f-8e44-763b3b707cc8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5e6c9e-1c19-4e8c-a19a-8ef157a0c7a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-352821821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10630d16-aa5a-4d3b-b1a9-977a54b912b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:38Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack sudo[87566]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9cd9c2-bda7-4331-b245-07b1acfb4ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db9cd9c2-bda7-4331-b245-07b1acfb4ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272defd5-6ddc-4579-9be3-0a12541c9c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272defd5-6ddc-4579-9be3-0a12541c9c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10630d16-aa5a-4d3b-b1a9-977a54b912b0', 'volume_name': 'volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48238beb-a2fd-4f52-a916-dee4a0700dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48238beb-a2fd-4f52-a916-dee4a0700dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef170683-dee3-443b-a38d-93c2767c7cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume 10630d16-aa5a-4d3b-b1a9-977a54b912b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0', 'volume_size': 1} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-352821821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10630d16-aa5a-4d3b-b1a9-977a54b912b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:38Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Creating volume 10630d16-aa5a-4d3b-b1a9-977a54b912b0 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:38 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-546718b9-5e13-40d7-a0d9-c6c92b216945" returned: 0 in 0.644s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:38 devstack sudo[87603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 1073741824 Apr 13 11:03:38 devstack sudo[87603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:38 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-59c1ec51-ba1d-4428-bba8-975b44cccc22 tempest-VolumesListAdminTestJSON-777298463 None] Created volume successfully. Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-546718b9-5e13-40d7-a0d9-c6c92b216945" released by "delete_volume" :: held 1.273s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Created reservations ['cfea2a5c-f760-41bb-8446-ea9a2218cf53'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:38 devstack cinder-volume[82656]: WARNING cinder.db.sqlalchemy.api [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1108248422'] Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Created reservations ['446be743-6693-4aaf-84e3-9d828dbd6518', 'b04686ae-9508-4e5e-bac9-1d58e7c58a96', '3058017c-7919-4cf3-b62c-894a0275856f', 'dfad271e-fb1c-405c-9e14-9cb336851028'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (ec0fcecf-a30e-49a4-8845-6447f62296af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a359dad3-6d06-42b2-ba9d-37725068b114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a359dad3-6d06-42b2-ba9d-37725068b114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1105002159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a563e214-b11c-4ba1-8871-5597b5a4bb01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:38Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b7fc51-1deb-4775-b891-f7b53aee7ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41b7fc51-1deb-4775-b891-f7b53aee7ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c3a5bd-1a4e-41a6-9bdb-18bafbaef284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94c3a5bd-1a4e-41a6-9bdb-18bafbaef284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a563e214-b11c-4ba1-8871-5597b5a4bb01', 'volume_name': 'volume-a563e214-b11c-4ba1-8871-5597b5a4bb01', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4332e9-174e-4131-9186-b13a9c2eff06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c4332e9-174e-4131-9186-b13a9c2eff06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0635be67-3228-49f4-a66a-ea5b8c3aac51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume a563e214-b11c-4ba1-8871-5597b5a4bb01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a563e214-b11c-4ba1-8871-5597b5a4bb01', 'volume_size': 1} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Acquiring lock "cinder-02fb2e68-2fbd-43c1-9750-a9cd998b17a1-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Lock "cinder-02fb2e68-2fbd-43c1-9750-a9cd998b17a1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:38 devstack sudo[87607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:38 devstack sudo[87607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "cinder-6927c0f5-61c3-4da4-a6f2-fb12fa52182e-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Acquiring lock "cinder-quobyte-02fb2e68-2fbd-43c1-9750-a9cd998b17a1" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-6927c0f5-61c3-4da4-a6f2-fb12fa52182e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Lock "cinder-quobyte-02fb2e68-2fbd-43c1-9750-a9cd998b17a1" acquired by "delete_volume" :: waited 0.054s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a4377-6493-4194-89ec-e65e1ccbd0ae]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "cinder-quobyte-6927c0f5-61c3-4da4-a6f2-fb12fa52182e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-quobyte-6927c0f5-61c3-4da4-a6f2-fb12fa52182e" acquired by "delete_volume" :: waited 0.020s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f87f489-143b-45e5-a892-acb722f793e1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:38 devstack sudo[87609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:38 devstack sudo[87609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:38 devstack sudo[87610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 Apr 13 11:03:38 devstack sudo[87610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:38 devstack sudo[87612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e Apr 13 11:03:38 devstack sudo[87612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (1ac235d0-92d4-4633-ad1c-4a24159e0f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0be09d4-1c14-4c7b-9693-8ad5277e78b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0be09d4-1c14-4c7b-9693-8ad5277e78b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-342662570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5528ad3f-557f-47d8-ac95-1caa21b9a3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:39Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc086865-5868-4fca-a06a-674d38e03e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc086865-5868-4fca-a06a-674d38e03e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18860951-1f9b-48ed-b6f7-2337d3f7fddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18860951-1f9b-48ed-b6f7-2337d3f7fddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5528ad3f-557f-47d8-ac95-1caa21b9a3ac', 'volume_name': 'volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9c1397-6488-4729-8ea4-c144e5ecba6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c9c1397-6488-4729-8ea4-c144e5ecba6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf39330-de9f-4ebe-97c6-a7d8869b93b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume 5528ad3f-557f-47d8-ac95-1caa21b9a3ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac', 'volume_size': 1} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:39 devstack sudo[87607]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.683s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d08b47d5-55a2-4db6-89e2-288f3ca6ceaf tempest-GroupSnapshotsTest-678215182 None] Delete group completed successfully. Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (a8338406-ab26-45b0-9869-103ee4b17cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a1a5b3-dedf-4b73-8f46-98a82db2a29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99a1a5b3-dedf-4b73-8f46-98a82db2a29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1540585258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:39Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3091d3-f902-4ff7-a5c1-10687e67dd8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3091d3-f902-4ff7-a5c1-10687e67dd8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06c6b17-6f25-48d7-9a12-93d7c71a87de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b06c6b17-6f25-48d7-9a12-93d7c71a87de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d', 'volume_name': 'volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e6a99d-e5a4-4dbf-84ba-5794b915652f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00e6a99d-e5a4-4dbf-84ba-5794b915652f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8debd3-85c3-4af8-9df1-06ea429cde9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d', 'volume_size': 1} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:39 devstack sudo[87603]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 1073741824" returned: 0 in 1.171s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:39 devstack sudo[87619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 Apr 13 11:03:39 devstack sudo[87619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:39 devstack sudo[87610]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1" returned: 0 in 0.855s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:39 devstack sudo[87625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1 Apr 13 11:03:39 devstack sudo[87625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:39 devstack sudo[87609]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.079s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (61e6109b-1575-464e-96d4-7b83a30f5dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:39 devstack sudo[87612]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0f7eba-a339-47ab-8f70-6205b4e9a31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e" returned: 0 in 1.080s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb0f7eba-a339-47ab-8f70-6205b4e9a31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986253163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2e5693-150c-4127-b6d0-35a6ed2c3e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:40Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8db9d3-2b87-498d-b89a-f8ab4d811d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8db9d3-2b87-498d-b89a-f8ab4d811d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9138ff71-8c2d-462d-8495-94585142fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9138ff71-8c2d-462d-8495-94585142fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b2e5693-150c-4127-b6d0-35a6ed2c3e60', 'volume_name': 'volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack sudo[87630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e Apr 13 11:03:39 devstack sudo[87630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a65189-fee8-4187-97ef-f994823f5cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a65189-fee8-4187-97ef-f994823f5cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3ec2f3-043f-43ee-971a-dc0b3228e738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:39 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume 0b2e5693-150c-4127-b6d0-35a6ed2c3e60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60', 'volume_size': 1} Apr 13 11:03:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-441b1621-fb30-4f43-964b-87dc72b66dc1 tempest-GroupSnapshotsTest-678215182 None] Group tempest-GroupSnapshotsTest-Group-1021773427: creating Apr 13 11:03:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-441b1621-fb30-4f43-964b-87dc72b66dc1 tempest-GroupSnapshotsTest-678215182 None] Group tempest-GroupSnapshotsTest-Group-1021773427: created successfully Apr 13 11:03:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-441b1621-fb30-4f43-964b-87dc72b66dc1 tempest-GroupSnapshotsTest-678215182 None] Create group completed successfully. Apr 13 11:03:40 devstack sudo[87619]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0" returned: 0 in 0.750s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.640s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1105002159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a563e214-b11c-4ba1-8871-5597b5a4bb01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:38Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Creating volume a563e214-b11c-4ba1-8871-5597b5a4bb01 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:40 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef170683-dee3-443b-a38d-93c2767c7cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d028ba7-0ef2-42d6-89fb-2e787c78ce25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:40 devstack sudo[87633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 1073741824 Apr 13 11:03:40 devstack sudo[87633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:40 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 (10630d16-aa5a-4d3b-b1a9-977a54b912b0): created successfully Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d028ba7-0ef2-42d6-89fb-2e787c78ce25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (87ffe413-611a-4e30-9fcc-5328cd50de5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:40 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f265a606-2d7b-4ab4-91ef-07d4777f3a7e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created volume successfully. Apr 13 11:03:40 devstack sudo[87625]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-02fb2e68-2fbd-43c1-9750-a9cd998b17a1" returned: 0 in 0.729s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Lock "cinder-quobyte-02fb2e68-2fbd-43c1-9750-a9cd998b17a1" released by "delete_volume" :: held 1.620s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:40 devstack sudo[87630]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-6927c0f5-61c3-4da4-a6f2-fb12fa52182e" returned: 0 in 0.505s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Created reservations ['7c47b8ca-e4a3-4918-8f93-2c0e1b6ffa2e', 'c0bcfd44-ab98-4211-9397-18671aa6f31c', 'fecb1692-2a39-4949-a2da-c720bc5a7a9c', 'b3ebbd49-0f7a-46b1-afec-1368845016ac'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-quobyte-6927c0f5-61c3-4da4-a6f2-fb12fa52182e" released by "delete_volume" :: held 1.633s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:40 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:40 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Created reservations ['2794a1c3-6628-48f2-854b-59e9abd3a7bc', '378d1aad-978d-439f-92ec-34a4766196d2', '441116c3-e5a7-4535-97f0-e1ab219bd843', 'bb28233c-c6ec-4528-bf91-6ede40f03ac4'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:40 devstack sudo[87639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:40 devstack sudo[87639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:40 devstack sudo[87633]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 1073741824" returned: 0 in 0.656s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:40 devstack sudo[87645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 Apr 13 11:03:40 devstack sudo[87645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:40 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.511s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:40 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Deleted volume successfully. Apr 13 11:03:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-fc13e177-92c6-4654-bb45-85a2d696d65f tempest-VolumesListAdminTestJSON-777298463 None] Lock "cinder-02fb2e68-2fbd-43c1-9750-a9cd998b17a1-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "cinder-745f4eee-063c-4f84-b370-24ee63db437b-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-745f4eee-063c-4f84-b370-24ee63db437b-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "cinder-quobyte-745f4eee-063c-4f84-b370-24ee63db437b" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-quobyte-745f4eee-063c-4f84-b370-24ee63db437b" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[171b3dd9-9e8d-46b8-9ef2-4948e61fc9b6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:41 devstack sudo[87639]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.692s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:41 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Deleted volume successfully. Apr 13 11:03:41 devstack sudo[87648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b Apr 13 11:03:41 devstack sudo[87648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5afcb9d9-00d7-4f58-bb6b-6246f93e9498 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-6927c0f5-61c3-4da4-a6f2-fb12fa52182e-delete_volume" released by "delete_volume" :: held 2.577s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:41 devstack sudo[87645]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01" returned: 0 in 0.569s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] <== create_volume: return (1274ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-342662570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5528ad3f-557f-47d8-ac95-1caa21b9a3ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:39Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Creating volume 5528ad3f-557f-47d8-ac95-1caa21b9a3ac {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:41 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0635be67-3228-49f4-a66a-ea5b8c3aac51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a563e214-b11c-4ba1-8871-5597b5a4bb01', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c2d56e-23e6-4b5f-aecb-777dce00e0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:41 devstack sudo[87651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac 1073741824 Apr 13 11:03:41 devstack sudo[87651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Flow 'volume_create_manager' (d741bb02-e366-457b-be8b-dc1b068c8574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c037077-9d53-4884-b520-4d71e3e001e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:41 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 (a563e214-b11c-4ba1-8871-5597b5a4bb01): created successfully Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04c2d56e-23e6-4b5f-aecb-777dce00e0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (ec0fcecf-a30e-49a4-8845-6447f62296af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c037077-9d53-4884-b520-4d71e3e001e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-135114847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15e6326-cfc1-4d59-bce4-e1658b827bc9,host='devstack@QuobyteHD#QuobyteHD',id=99230c3e-0a46-43cb-aecc-b7a4e9f4a410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418d3141293d4cec8dd6dc4f342dc574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:41Z,use_quota=True,user_id='896e78490c70419680a741c693276de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24e21d53-8998-4d40-9c6e-779e756b0fa8),volume_type_id=24e21d53-8998-4d40-9c6e-779e756b0fa8)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32ebf60-d9cb-4ca8-9410-c6363b9ed0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e32ebf60-d9cb-4ca8-9410-c6363b9ed0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd69632-293e-4c6a-b87b-3f2275966490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fd69632-293e-4c6a-b87b-3f2275966490) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99230c3e-0a46-43cb-aecc-b7a4e9f4a410', 'volume_name': 'volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c384a9c3-48ed-4096-b004-2ea1f4441639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c384a9c3-48ed-4096-b004-2ea1f4441639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d0e899-31bd-4a76-9d69-db3feee278fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:41 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Volume 99230c3e-0a46-43cb-aecc-b7a4e9f4a410: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410', 'volume_size': 1} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:41 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-de6e5e38-e0da-4167-b7d0-eb3ab4a2c225 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created volume successfully. Apr 13 11:03:41 devstack sudo[87648]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b" returned: 0 in 0.668s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:41 devstack sudo[87659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b Apr 13 11:03:41 devstack sudo[87659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Acquiring lock "cinder-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Lock "cinder-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Acquiring lock "cinder-quobyte-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Lock "cinder-quobyte-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd82b458-49ae-4726-b3ca-447718f2c417]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:42 devstack sudo[87651]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac 1073741824" returned: 0 in 0.667s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:42 devstack sudo[87664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 Apr 13 11:03:42 devstack sudo[87664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:42 devstack sudo[87667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac Apr 13 11:03:42 devstack sudo[87667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:42 devstack sudo[87659]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-745f4eee-063c-4f84-b370-24ee63db437b" returned: 0 in 0.445s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-quobyte-745f4eee-063c-4f84-b370-24ee63db437b" released by "delete_volume" :: held 1.144s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Created reservations ['7bb255c4-5621-4022-9b8e-7e79f7918db1', '973a0ae8-58a0-43d5-b1e5-124f8b2a31b5', '38ba0a63-0bde-4bfe-8230-2b631763349c', 'd1f9c541-2316-4eb3-ad35-57e662a18a78'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:42 devstack sudo[87669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:42 devstack sudo[87669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:42 devstack sudo[87664]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5" returned: 0 in 0.498s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:42 devstack sudo[87675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5 Apr 13 11:03:42 devstack sudo[87675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:42 devstack sudo[87667]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.186s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.264s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1540585258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:39Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Creating volume e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:42 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adf39330-de9f-4ebe-97c6-a7d8869b93b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117f68d3-1215-4b53-a2e9-1a9e428c15b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:42 devstack sudo[87677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d 1073741824 Apr 13 11:03:42 devstack sudo[87677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:42 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac (5528ad3f-557f-47d8-ac95-1caa21b9a3ac): created successfully Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (117f68d3-1215-4b53-a2e9-1a9e428c15b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (1ac235d0-92d4-4633-ad1c-4a24159e0f32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c07784d0-b67f-421e-a80e-bf53f3626f9b tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created volume successfully. Apr 13 11:03:42 devstack sudo[87669]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.476s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Deleted volume successfully. Apr 13 11:03:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-735ebb64-366c-42a9-a713-2fc82b316f27 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-745f4eee-063c-4f84-b370-24ee63db437b-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:43 devstack sudo[87675]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5" returned: 0 in 0.499s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Lock "cinder-quobyte-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5" released by "delete_volume" :: held 1.019s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Created reservations ['a7ad35ef-7a28-4c15-b088-506a0ec2e8ca', '99ec66a0-ff75-4eab-aede-7591ed64ea79', 'a4fc7dd5-a509-48d5-b054-6716bd1a4cfe', '6cdabe44-9ac5-4059-9ac7-dd0a374a0073'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:43 devstack sudo[87684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:43 devstack sudo[87684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:43 devstack sudo[87677]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d 1073741824" returned: 0 in 0.563s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:43 devstack sudo[87686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d Apr 13 11:03:43 devstack sudo[87686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "cinder-8db35b41-9db1-4f8b-895c-9d3cee7366db-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-8db35b41-9db1-4f8b-895c-9d3cee7366db-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "cinder-quobyte-8db35b41-9db1-4f8b-895c-9d3cee7366db" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-quobyte-8db35b41-9db1-4f8b-895c-9d3cee7366db" acquired by "delete_volume" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca474be0-955c-49cf-9fea-2add8ab7cba2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:43 devstack sudo[87688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db Apr 13 11:03:43 devstack sudo[87688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:43 devstack sudo[87684]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.494s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Deleted volume successfully. Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e355f115-c565-4080-8327-2ef21cd91dd2 tempest-VolumesNegativeTest-1182556483 None] Lock "cinder-cf65a6a4-e8bb-47ff-9265-b977d8abbfa5-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:43 devstack sudo[87686]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d" returned: 0 in 0.460s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.776s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1986253163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b2e5693-150c-4127-b6d0-35a6ed2c3e60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e58e5de2f374a0793ef45e5e3164108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:40Z,use_quota=True,user_id='80c8fe9b18f94d8bad680932e3258a00',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Creating volume 0b2e5693-150c-4127-b6d0-35a6ed2c3e60 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:43 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb8debd3-85c3-4af8-9df1-06ea429cde9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2216ffc6-b39b-48f1-bdbc-9c42f37daa3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:43 devstack sudo[87692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 1073741824 Apr 13 11:03:43 devstack sudo[87692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:43 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d (e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d): created successfully Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2216ffc6-b39b-48f1-bdbc-9c42f37daa3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (a8338406-ab26-45b0-9869-103ee4b17cf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-24693119-a390-4916-a7d2-f3507d6f4cae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created volume successfully. Apr 13 11:03:43 devstack sudo[87688]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db" returned: 0 in 0.490s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:43 devstack sudo[87697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db Apr 13 11:03:43 devstack sudo[87697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:44 devstack sudo[87692]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 1073741824" returned: 0 in 0.569s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:44 devstack sudo[87697]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8db35b41-9db1-4f8b-895c-9d3cee7366db" returned: 0 in 0.443s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:44 devstack sudo[87703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 Apr 13 11:03:44 devstack sudo[87703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-quobyte-8db35b41-9db1-4f8b-895c-9d3cee7366db" released by "delete_volume" :: held 0.964s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Created reservations ['4247b3ac-abd4-4c92-8dc4-f91b53259388', '7e025a33-19e8-4d70-ab33-eec3253bcebf', '2268e159-ad5d-4f82-a18f-d4ef1d50d3cb', 'f568cda0-0dae-40de-aac7-d0f5a3dab3bb'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:44 devstack sudo[87705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:44 devstack sudo[87705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:44 devstack sudo[87703]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60" returned: 0 in 0.481s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.206s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f15e6326-cfc1-4d59-bce4-e1658b827bc9,created_at=2026-04-13T09:03:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-135114847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15e6326-cfc1-4d59-bce4-e1658b827bc9,host='devstack@QuobyteHD#QuobyteHD',id=99230c3e-0a46-43cb-aecc-b7a4e9f4a410,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418d3141293d4cec8dd6dc4f342dc574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:41Z,use_quota=True,user_id='896e78490c70419680a741c693276de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24e21d53-8998-4d40-9c6e-779e756b0fa8),volume_type_id=24e21d53-8998-4d40-9c6e-779e756b0fa8)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Creating volume 99230c3e-0a46-43cb-aecc-b7a4e9f4a410 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:44 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c3ec2f3-043f-43ee-971a-dc0b3228e738) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:44 devstack sudo[87709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 1073741824 Apr 13 11:03:44 devstack sudo[87709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a26fb4-8ed7-4766-91c8-c1ff098ddfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:44 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Volume volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 (0b2e5693-150c-4127-b6d0-35a6ed2c3e60): created successfully Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95a26fb4-8ed7-4766-91c8-c1ff098ddfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Flow 'volume_create_manager' (61e6109b-1575-464e-96d4-7b83a30f5dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:44 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5c58e154-5aab-4893-b7d7-90d81e96fa42 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created volume successfully. Apr 13 11:03:44 devstack sudo[87705]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.457s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:44 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Deleted volume successfully. Apr 13 11:03:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e9c5b021-9505-49a4-a948-558c4340adb4 tempest-VolumesListAdminTestJSON-937817984 None] Lock "cinder-8db35b41-9db1-4f8b-895c-9d3cee7366db-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-0b2e5693-150c-4127-b6d0-35a6ed2c3e60-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-0b2e5693-150c-4127-b6d0-35a6ed2c3e60-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-quobyte-0b2e5693-150c-4127-b6d0-35a6ed2c3e60" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-0b2e5693-150c-4127-b6d0-35a6ed2c3e60" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f927fd-dfa8-4d64-a4f0-e982517e9720]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:45 devstack sudo[87709]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 1073741824" returned: 0 in 0.569s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:45 devstack sudo[87715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 Apr 13 11:03:45 devstack sudo[87715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:45 devstack sudo[87714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 Apr 13 11:03:45 devstack sudo[87714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:45 devstack sudo[87715]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" returned: 0 in 0.522s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08d0e899-31bd-4a76-9d69-db3feee278fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f595e8-f7b3-4920-9334-f5a9eaee22bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:45 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Volume volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 (99230c3e-0a46-43cb-aecc-b7a4e9f4a410): created successfully Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0f595e8-f7b3-4920-9334-f5a9eaee22bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Flow 'volume_create_manager' (d741bb02-e366-457b-be8b-dc1b068c8574) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:45 devstack sudo[87714]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60" returned: 0 in 0.637s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b96b0e80-a735-4eb5-bfa2-fc33a2a93244 tempest-GroupSnapshotsTest-678215182 None] Created volume successfully. Apr 13 11:03:46 devstack sudo[87722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60 Apr 13 11:03:46 devstack sudo[87722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (40115047-b8ea-4553-8a67-bd528bba7e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29d76b2-47a3-4178-ad91-e8b27362d604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d29d76b2-47a3-4178-ad91-e8b27362d604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-512784165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe6e132-5193-47ea-90cd-6d8638acdc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:46Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc2f74c-a3ff-4ecb-8862-66229c9cb066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddc2f74c-a3ff-4ecb-8862-66229c9cb066) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c2f071-3fee-4501-bb83-98ddbc7faa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5c2f071-3fee-4501-bb83-98ddbc7faa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbe6e132-5193-47ea-90cd-6d8638acdc3a', 'volume_name': 'volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ec8e02-7ced-4ded-b32f-16408a92ee08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39ec8e02-7ced-4ded-b32f-16408a92ee08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9655fc54-b237-448c-8d61-036e92c96820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:46 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume fbe6e132-5193-47ea-90cd-6d8638acdc3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a', 'volume_size': 1} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-512784165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbe6e132-5193-47ea-90cd-6d8638acdc3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:46Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Creating volume fbe6e132-5193-47ea-90cd-6d8638acdc3a {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:46 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:46 devstack sudo[87724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a 1073741824 Apr 13 11:03:46 devstack sudo[87724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:46 devstack sudo[87722]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0b2e5693-150c-4127-b6d0-35a6ed2c3e60" returned: 0 in 0.505s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-0b2e5693-150c-4127-b6d0-35a6ed2c3e60" released by "delete_volume" :: held 1.191s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created reservations ['9b8745f1-5721-464d-9b40-b5af4633ad02', 'c36f8b63-19c6-418c-99ba-e05068996c65', 'b1a5884b-bbcc-4bb9-bfd7-025b3cb0679b', '59058295-ca42-4f3f-acc5-52dd6ce4dab6'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:46 devstack sudo[87730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:46 devstack sudo[87730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:46 devstack sudo[87724]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a 1073741824" returned: 0 in 0.579s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:46 devstack sudo[87732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a Apr 13 11:03:46 devstack sudo[87732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Flow 'volume_create_manager' (a58e0065-38da-4a88-93b9-be3ed399200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbc5a01-9236-433f-960c-31d576025714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:47 devstack sudo[87732]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a" returned: 0 in 0.517s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:47 devstack sudo[87730]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9655fc54-b237-448c-8d61-036e92c96820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720ddd0e-6596-4b7f-9c58-a9e88007fbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbc5a01-9236-433f-960c-31d576025714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1822097482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15e6326-cfc1-4d59-bce4-e1658b827bc9,host='devstack@QuobyteHD#QuobyteHD',id=63f1edf9-75b0-4bcb-8642-c4ce8d16da7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418d3141293d4cec8dd6dc4f342dc574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:47Z,use_quota=True,user_id='896e78490c70419680a741c693276de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24e21d53-8998-4d40-9c6e-779e756b0fa8),volume_type_id=24e21d53-8998-4d40-9c6e-779e756b0fa8)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb9cbc0-9c0d-4a7e-bbe4-b9a6ad465c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cb9cbc0-9c0d-4a7e-bbe4-b9a6ad465c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98d39be-7858-4b06-991e-6c7fce48d94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a98d39be-7858-4b06-991e-6c7fce48d94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63f1edf9-75b0-4bcb-8642-c4ce8d16da7f', 'volume_name': 'volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2aa284-bded-49c8-a7c3-08c0f2616570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff2aa284-bded-49c8-a7c3-08c0f2616570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353a4587-4cfa-4fb7-a13f-8155e3d9e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:47 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Volume 63f1edf9-75b0-4bcb-8642-c4ce8d16da7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f', 'volume_size': 1} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f15e6326-cfc1-4d59-bce4-e1658b827bc9,created_at=2026-04-13T09:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1822097482',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f15e6326-cfc1-4d59-bce4-e1658b827bc9,host='devstack@QuobyteHD#QuobyteHD',id=63f1edf9-75b0-4bcb-8642-c4ce8d16da7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418d3141293d4cec8dd6dc4f342dc574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:47Z,use_quota=True,user_id='896e78490c70419680a741c693276de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(24e21d53-8998-4d40-9c6e-779e756b0fa8),volume_type_id=24e21d53-8998-4d40-9c6e-779e756b0fa8)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Creating volume 63f1edf9-75b0-4bcb-8642-c4ce8d16da7f {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:47 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:47 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a (fbe6e132-5193-47ea-90cd-6d8638acdc3a): created successfully Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720ddd0e-6596-4b7f-9c58-a9e88007fbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (40115047-b8ea-4553-8a67-bd528bba7e1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.723s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:47 devstack sudo[87736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f 1073741824 Apr 13 11:03:47 devstack sudo[87736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:47 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Deleted volume successfully. Apr 13 11:03:47 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-29ae675c-2828-44f8-afbf-e9f9d5089ab2 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created volume successfully. Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-922da3a3-f4ec-40ea-8780-0181eaa17e3e tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-0b2e5693-150c-4127-b6d0-35a6ed2c3e60-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-quobyte-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[03750850-b879-4e24-b2f2-c9bc297ea526]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:47 devstack sudo[87738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d Apr 13 11:03:47 devstack sudo[87738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:47 devstack sudo[87736]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f 1073741824" returned: 0 in 0.600s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:47 devstack sudo[87743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f Apr 13 11:03:47 devstack sudo[87743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:48 devstack sudo[87738]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d" returned: 0 in 0.571s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:48 devstack sudo[87748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d Apr 13 11:03:48 devstack sudo[87748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Flow 'volume_create_manager' (9245dd9d-9f80-4542-a95e-23195ad2c7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6542246-7ed6-49db-a7ea-14b93d075467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6542246-7ed6-49db-a7ea-14b93d075467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1684249777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf69314-90c1-421c-979e-7b45eb63ed55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7db368a626f48f88dd5b7139ba51797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:48Z,use_quota=True,user_id='e5017d84ada54d3686d4649368d592b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5e7b5e-0721-4a88-b6ff-56755c2f627d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d5e7b5e-0721-4a88-b6ff-56755c2f627d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d878e52-a2a7-4399-99a7-e47d05532352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d878e52-a2a7-4399-99a7-e47d05532352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caf69314-90c1-421c-979e-7b45eb63ed55', 'volume_name': 'volume-caf69314-90c1-421c-979e-7b45eb63ed55', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd25002-1643-47c4-b978-df2f84668d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bd25002-1643-47c4-b978-df2f84668d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde7d705-67cf-478f-9257-d621e7a0bacc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Volume caf69314-90c1-421c-979e-7b45eb63ed55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caf69314-90c1-421c-979e-7b45eb63ed55', 'volume_size': 1} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:48 devstack sudo[87743]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" returned: 0 in 0.597s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] <== create_volume: return (1222ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.224s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1684249777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caf69314-90c1-421c-979e-7b45eb63ed55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7db368a626f48f88dd5b7139ba51797',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:48Z,use_quota=True,user_id='e5017d84ada54d3686d4649368d592b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Creating volume caf69314-90c1-421c-979e-7b45eb63ed55 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:48 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:48 devstack sudo[87752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 1073741824 Apr 13 11:03:48 devstack sudo[87752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (353a4587-4cfa-4fb7-a13f-8155e3d9e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8f60f2-914d-4fe1-a33e-2dada12a61a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Volume volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f (63f1edf9-75b0-4bcb-8642-c4ce8d16da7f): created successfully Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c8f60f2-914d-4fe1-a33e-2dada12a61a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Flow 'volume_create_manager' (a58e0065-38da-4a88-93b9-be3ed399200c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:48 devstack sudo[87748]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (73232d4c-887b-4787-a8b2-cfc1b28b101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96109d0-1031-4160-baa1-1d0b28ed6608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3423b2dd-f7f8-45c3-bdfd-82ef5184aaee tempest-GroupSnapshotsTest-678215182 None] Created volume successfully. Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d" returned: 0 in 0.504s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e96109d0-1031-4160-baa1-1d0b28ed6608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403305427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ec177a-da97-47d6-b1fd-b5fa91c8332c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90bbcb4-dd89-49cf-86c5-4285aebe7b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e90bbcb4-dd89-49cf-86c5-4285aebe7b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaf24bc-9a77-41dc-b491-4d6390084b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdaf24bc-9a77-41dc-b491-4d6390084b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40ec177a-da97-47d6-b1fd-b5fa91c8332c', 'volume_name': 'volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d162766-5b85-4b8e-b214-ed0a20ada0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d162766-5b85-4b8e-b214-ed0a20ada0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1320a8-20e0-448b-9e73-da646ddee47d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume 40ec177a-da97-47d6-b1fd-b5fa91c8332c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c', 'volume_size': 1} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d" released by "delete_volume" :: held 1.126s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created reservations ['dc67408d-3d5b-4780-a35d-b8307ad35673', 'cae369f2-54a8-4e71-9c3a-8e24cf6470bb', '9b18af87-449a-494c-803a-866a80ad316c', '73eb1c59-b109-4c6a-a523-e29fd9e449dc'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:48 devstack sudo[87754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:48 devstack sudo[87754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (e1ec4008-5c4e-4a52-9619-37b0c4e61c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b5f6c6-d1f6-421d-9238-f53160d8fb95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b5f6c6-d1f6-421d-9238-f53160d8fb95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-890807054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0152f8fc-e56b-4994-8bb2-852b1f26fad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c48904-13fe-493d-bd0f-0fca2dbf2c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c48904-13fe-493d-bd0f-0fca2dbf2c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4ea098-9ece-412c-8236-15d203bfa19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a4ea098-9ece-412c-8236-15d203bfa19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0152f8fc-e56b-4994-8bb2-852b1f26fad6', 'volume_name': 'volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77592bbf-05b5-4760-bb02-dfdf1a7fc893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77592bbf-05b5-4760-bb02-dfdf1a7fc893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a996bec6-442d-4784-8853-f2db631e7607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume 0152f8fc-e56b-4994-8bb2-852b1f26fad6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6', 'volume_size': 1} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:48 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (5a3bd57e-88a0-4c5f-b0e8-ef86a098a5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7438b74e-cce3-4a51-802b-57ca8231ee04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7438b74e-cce3-4a51-802b-57ca8231ee04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1232967035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0a56bf-4306-4801-91f2-7ee806a2e1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ef1d3-ff18-48cd-8760-dd4ca8abfbe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90ef1d3-ff18-48cd-8760-dd4ca8abfbe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cda9daf-0963-43d5-bafc-b8a26f980aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cda9daf-0963-43d5-bafc-b8a26f980aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b0a56bf-4306-4801-91f2-7ee806a2e1da', 'volume_name': 'volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae7213b-b229-4e72-ad7e-27da03379b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae7213b-b229-4e72-ad7e-27da03379b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c1a2be-7ea4-4f77-b543-532f83def8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume 9b0a56bf-4306-4801-91f2-7ee806a2e1da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da', 'volume_size': 1} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:49 devstack sudo[87752]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 1073741824" returned: 0 in 0.594s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:49 devstack sudo[87759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 Apr 13 11:03:49 devstack sudo[87759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (2aa7733a-127d-457a-b75f-69622968a0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5004b3-0ce3-43b8-9f21-6d7fd7e9eb65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a5004b3-0ce3-43b8-9f21-6d7fd7e9eb65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703151833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161995f4-4749-4e95-9151-0a6e85e830a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bad2432-14a7-4286-ba65-f63eab25ecb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bad2432-14a7-4286-ba65-f63eab25ecb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ce840d-21db-40ce-9c1f-738c815a1252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3ce840d-21db-40ce-9c1f-738c815a1252) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161995f4-4749-4e95-9151-0a6e85e830a5', 'volume_name': 'volume-161995f4-4749-4e95-9151-0a6e85e830a5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4536f098-bd78-41e0-8ae7-8141d43c8e56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4536f098-bd78-41e0-8ae7-8141d43c8e56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2984246c-a1ee-4355-b7e5-30ef16f6ecae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume 161995f4-4749-4e95-9151-0a6e85e830a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161995f4-4749-4e95-9151-0a6e85e830a5', 'volume_size': 1} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:49 devstack sudo[87754]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.558s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:49 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Deleted volume successfully. Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0a5ba497-f8cc-4fbb-a637-2df6773c6255 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-e9e1dbb6-0ed8-49cd-a76b-ac1bfb41dc2d-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (a7beb12b-a1d1-4376-aa67-06d396c349ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0617e45-f3ec-4c5a-ac20-863bdabc63f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0617e45-f3ec-4c5a-ac20-863bdabc63f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43290212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7584c5-1cfb-4e34-a1fc-89f569d9ac73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103ba8ed-5018-4587-9cfb-43a1933f2db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (103ba8ed-5018-4587-9cfb-43a1933f2db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d527b1-d81f-4e1a-a7f6-b924194f5b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45d527b1-d81f-4e1a-a7f6-b924194f5b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e7584c5-1cfb-4e34-a1fc-89f569d9ac73', 'volume_name': 'volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def8c16b-627f-4244-aaae-a99d66d7f59d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (def8c16b-627f-4244-aaae-a99d66d7f59d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf308f4-dedd-428f-88e5-21a7abcc155c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume 8e7584c5-1cfb-4e34-a1fc-89f569d9ac73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73', 'volume_size': 1} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:49 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9033f493-ca65-4bc1-a15e-7d8332395ebe tempest-GroupSnapshotsTest-678215182 None] Update group completed successfully. Apr 13 11:03:49 devstack sudo[87759]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55" returned: 0 in 0.497s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.986s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-403305427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40ec177a-da97-47d6-b1fd-b5fa91c8332c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Creating volume 40ec177a-da97-47d6-b1fd-b5fa91c8332c {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:49 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fde7d705-67cf-478f-9257-d621e7a0bacc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caf69314-90c1-421c-979e-7b45eb63ed55', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9c1500-3dbd-4c0d-8902-067312b995df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:49 devstack sudo[87763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c 1073741824 Apr 13 11:03:49 devstack sudo[87763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-5528ad3f-557f-47d8-ac95-1caa21b9a3ac-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:49 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Volume volume-caf69314-90c1-421c-979e-7b45eb63ed55 (caf69314-90c1-421c-979e-7b45eb63ed55): created successfully Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae9c1500-3dbd-4c0d-8902-067312b995df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Flow 'volume_create_manager' (9245dd9d-9f80-4542-a95e-23195ad2c7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-5528ad3f-557f-47d8-ac95-1caa21b9a3ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:49 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8e9458be-3026-44dd-8be9-2f9f4abde240 tempest-VolumesMetadataTest-1309532968 None] Created volume successfully. Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-quobyte-5528ad3f-557f-47d8-ac95-1caa21b9a3ac" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-5528ad3f-557f-47d8-ac95-1caa21b9a3ac" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea567abd-9473-4feb-acb4-f86455f37d3a]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:49 devstack sudo[87765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac Apr 13 11:03:49 devstack sudo[87765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:50 devstack sudo[87763]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c 1073741824" returned: 0 in 0.495s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:50 devstack sudo[87773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c Apr 13 11:03:50 devstack sudo[87773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:50 devstack sudo[87765]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac" returned: 0 in 0.481s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:50 devstack sudo[87775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac Apr 13 11:03:50 devstack sudo[87775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:50 devstack sudo[87773]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c" returned: 0 in 0.415s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-890807054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0152f8fc-e56b-4994-8bb2-852b1f26fad6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Creating volume 0152f8fc-e56b-4994-8bb2-852b1f26fad6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:50 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec1320a8-20e0-448b-9e73-da646ddee47d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dfd203-a3df-42a1-b637-0568a7a2a4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:50 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c (40ec177a-da97-47d6-b1fd-b5fa91c8332c): created successfully Apr 13 11:03:50 devstack sudo[87779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 1073741824 Apr 13 11:03:50 devstack sudo[87779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0dfd203-a3df-42a1-b637-0568a7a2a4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (73232d4c-887b-4787-a8b2-cfc1b28b101e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:50 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-00f9b8c2-c3f1-4e96-9f12-a2b4e95a59a8 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created volume successfully. Apr 13 11:03:50 devstack sudo[87775]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5528ad3f-557f-47d8-ac95-1caa21b9a3ac" returned: 0 in 0.454s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-5528ad3f-557f-47d8-ac95-1caa21b9a3ac" released by "delete_volume" :: held 0.976s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created reservations ['0e645a4e-7ad4-4bc7-838f-567685b8f1c8', '149ffb22-0699-4323-aef0-4ae2c3bca661', 'c0698d31-8e22-4306-bb06-8e19e433a58e', 'f58f8e2d-b1d6-4502-9294-13de937d958f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:50 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-530bb53e-1f9e-4d86-94ee-7dbd1201985f tempest-GroupSnapshotsTest-678215182 None] Update group completed successfully. Apr 13 11:03:50 devstack sudo[87781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:50 devstack sudo[87781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-a563e214-b11c-4ba1-8871-5597b5a4bb01-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-a563e214-b11c-4ba1-8871-5597b5a4bb01-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-quobyte-a563e214-b11c-4ba1-8871-5597b5a4bb01" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-a563e214-b11c-4ba1-8871-5597b5a4bb01" acquired by "delete_volume" :: waited 0.024s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e9047b-ef8e-4b86-93dd-81cdd650b657]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:51 devstack sudo[87783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 Apr 13 11:03:51 devstack sudo[87783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:51 devstack sudo[87779]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 1073741824" returned: 0 in 0.616s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:51 devstack sudo[87789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 Apr 13 11:03:51 devstack sudo[87789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Acquiring lock "cinder-caf69314-90c1-421c-979e-7b45eb63ed55-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:51 devstack sudo[87781]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.539s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Lock "cinder-caf69314-90c1-421c-979e-7b45eb63ed55-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:51 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Deleted volume successfully. Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-918af149-71be-4b7d-83d1-3781fb0f0dae tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-5528ad3f-557f-47d8-ac95-1caa21b9a3ac-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Acquiring lock "cinder-quobyte-caf69314-90c1-421c-979e-7b45eb63ed55" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Lock "cinder-quobyte-caf69314-90c1-421c-979e-7b45eb63ed55" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa663be-f2bc-445f-8a3e-b7d76ce4a7fd]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:51 devstack sudo[87791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 Apr 13 11:03:51 devstack sudo[87791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:51 devstack sudo[87783]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01" returned: 0 in 0.720s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:51 devstack sudo[87797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01 Apr 13 11:03:51 devstack sudo[87797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:51 devstack sudo[87789]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6" returned: 0 in 0.491s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.700s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1232967035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b0a56bf-4306-4801-91f2-7ee806a2e1da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Creating volume 9b0a56bf-4306-4801-91f2-7ee806a2e1da {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:51 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:51 devstack sudo[87800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da 1073741824 Apr 13 11:03:51 devstack sudo[87800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a996bec6-442d-4784-8853-f2db631e7607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31347431-aff1-492d-88f5-933e17e738fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:51 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 (0152f8fc-e56b-4994-8bb2-852b1f26fad6): created successfully Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31347431-aff1-492d-88f5-933e17e738fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (e1ec4008-5c4e-4a52-9619-37b0c4e61c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:51 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e7b012cc-dca2-4dd3-90fa-9ae3895ffcf0 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created volume successfully. Apr 13 11:03:51 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8561dbac-9604-47e2-8e02-2fd223823a20 tempest-GroupSnapshotsTest-678215182 None] Update group completed successfully. Apr 13 11:03:52 devstack sudo[87791]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55" returned: 0 in 0.606s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:52 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55 Apr 13 11:03:52 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:52 devstack sudo[87797]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a563e214-b11c-4ba1-8871-5597b5a4bb01" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-a563e214-b11c-4ba1-8871-5597b5a4bb01" released by "delete_volume" :: held 1.200s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created reservations ['ab62e4e2-14c6-4b49-8531-100bd00c69ea', '33607cd1-9ea1-4a33-bac2-239d4650c4aa', 'ac3c9c81-3058-447e-a513-64036194f1ad', '4ccaba20-ef03-45d7-8b52-ba13c2f7834f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:52 devstack sudo[87811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:52 devstack sudo[87811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:52 devstack sudo[87800]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da 1073741824" returned: 0 in 0.500s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:52 devstack sudo[87813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da Apr 13 11:03:52 devstack sudo[87813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:52 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-caf69314-90c1-421c-979e-7b45eb63ed55" returned: 0 in 0.479s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Lock "cinder-quobyte-caf69314-90c1-421c-979e-7b45eb63ed55" released by "delete_volume" :: held 1.111s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Created reservations ['0d81295d-d701-4426-bb82-f1166a9e012b', '5f2d4294-4f93-4fad-a647-78de3c4c7224', '14167535-325d-4fae-9411-d7b7cc35d191', '2ed72c9b-cd12-4c86-b5bb-663777e21d22'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:52 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:52 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:52 devstack sudo[87811]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.447s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:52 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Deleted volume successfully. Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2878a190-fdd9-4a2e-b86e-34dac1e136b5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-a563e214-b11c-4ba1-8871-5597b5a4bb01-delete_volume" released by "delete_volume" :: held 1.820s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:52 devstack sudo[87813]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da" returned: 0 in 0.459s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.511s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703151833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161995f4-4749-4e95-9151-0a6e85e830a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Creating volume 161995f4-4749-4e95-9151-0a6e85e830a5 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:52 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4c1a2be-7ea4-4f77-b543-532f83def8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4319dc36-3546-4977-a372-8e6deb4fb833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:52 devstack sudo[87820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 1073741824 Apr 13 11:03:52 devstack sudo[87820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:52 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da (9b0a56bf-4306-4801-91f2-7ee806a2e1da): created successfully Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4319dc36-3546-4977-a372-8e6deb4fb833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:52 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (5a3bd57e-88a0-4c5f-b0e8-ef86a098a5ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:52 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-50870e36-2ca8-4c0d-a462-4271dd7b7789 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created volume successfully. Apr 13 11:03:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-48a91211-5b68-469d-879a-3a48fd6b2b55 tempest-GroupSnapshotsTest-678215182 None] Update group completed successfully. Apr 13 11:03:53 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.458s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-10630d16-aa5a-4d3b-b1a9-977a54b912b0-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Deleted volume successfully. Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-10630d16-aa5a-4d3b-b1a9-977a54b912b0-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbe1f9c0-f0f5-4b96-a144-bc58b6c01d6d tempest-VolumesMetadataTest-1309532968 None] Lock "cinder-caf69314-90c1-421c-979e-7b45eb63ed55-delete_volume" released by "delete_volume" :: held 1.775s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-quobyte-10630d16-aa5a-4d3b-b1a9-977a54b912b0" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-10630d16-aa5a-4d3b-b1a9-977a54b912b0" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[4813343d-b3ba-494e-bc9b-dffd64d499ec]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:53 devstack sudo[87826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 Apr 13 11:03:53 devstack sudo[87826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:53 devstack sudo[87820]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 1073741824" returned: 0 in 0.535s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:53 devstack sudo[87828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 Apr 13 11:03:53 devstack sudo[87828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:53 devstack sudo[87826]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0" returned: 0 in 0.531s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:53 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0 Apr 13 11:03:53 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:53 devstack sudo[87828]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5" returned: 0 in 0.501s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.066s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.336s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-43290212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e7584c5-1cfb-4e34-a1fc-89f569d9ac73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64cf81019d58447f872a62e32ba5dbad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:03:49Z,use_quota=True,user_id='b3a3adcbe57d4915b9994f458f4d28b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Creating volume 8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:03:53 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2984246c-a1ee-4355-b7e5-30ef16f6ecae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161995f4-4749-4e95-9151-0a6e85e830a5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:53 devstack sudo[87836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 1073741824 Apr 13 11:03:53 devstack sudo[87836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b19690c-be6b-4551-a8a5-dd6039597d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:53 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume volume-161995f4-4749-4e95-9151-0a6e85e830a5 (161995f4-4749-4e95-9151-0a6e85e830a5): created successfully Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b19690c-be6b-4551-a8a5-dd6039597d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (2aa7733a-127d-457a-b75f-69622968a0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d3495be3-f4f7-4c40-a35e-906086893326 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created volume successfully. Apr 13 11:03:54 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-10630d16-aa5a-4d3b-b1a9-977a54b912b0" returned: 0 in 0.506s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-10630d16-aa5a-4d3b-b1a9-977a54b912b0" released by "delete_volume" :: held 1.063s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=245,cinder:UPDATE=312,cinder:INSERT=78,cinder:DELETE=20 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created reservations ['5657d777-67cc-42e6-90d4-95884a6dcd3a', '4e6d0da7-2790-4647-b213-afb7e991021e', 'bd03ee93-2f2f-45ab-b2e7-5902ce89f96b', 'dcb33c1b-942e-4a85-9428-47c893bbb65f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:54 devstack sudo[87842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:54 devstack sudo[87842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] GroupSnapshot af782b8c-4ba8-4497-b7ac-ef3bbcacd2fd: creating. Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Group snapshot af782b8c-4ba8-4497-b7ac-ef3bbcacd2fd: creating. {{(pid=82656) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:54 devstack sudo[87836]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 1073741824" returned: 0 in 0.690s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:54 devstack sudo[87844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 Apr 13 11:03:54 devstack sudo[87844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:54 devstack sudo[87842]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.494s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Deleted volume successfully. Apr 13 11:03:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-78955dd0-7610-4472-8049-4331e05eb0bd tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-10630d16-aa5a-4d3b-b1a9-977a54b912b0-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:55 devstack sudo[87844]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73" returned: 0 in 0.491s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] <== create_volume: return (1209ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.598s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Creating offline snapshot 5bbe069b-934c-4ec1-ad40-d9317bc8a905 of volume 99230c3e-0a46-43cb-aecc-b7a4e9f4a410 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ddf308f4-dedd-428f-88e5-21a7abcc155c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9156978-9364-463f-baa9-194c350274e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed9832b-272a-4671-87dc-f1b6e4a4c87b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:55 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Volume volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 (8e7584c5-1cfb-4e34-a1fc-89f569d9ac73): created successfully Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9156978-9364-463f-baa9-194c350274e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Flow 'volume_create_manager' (a7beb12b-a1d1-4376-aa67-06d396c349ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:03:55 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-29d411d8-67cf-4571-a88d-607b024282cb tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created volume successfully. Apr 13 11:03:55 devstack sudo[87848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 Apr 13 11:03:55 devstack sudo[87848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-149e9393-9b58-4324-9756-e6e44e1a4e37-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-149e9393-9b58-4324-9756-e6e44e1a4e37-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-quobyte-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-quobyte-149e9393-9b58-4324-9756-e6e44e1a4e37" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-149e9393-9b58-4324-9756-e6e44e1a4e37" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Deleting offline snapshot 149e9393-9b58-4324-9756-e6e44e1a4e37 of volume 7d23f45d-fdd6-4a8c-9d87-6994986a01e6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] snapshot_file for this snap is: volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[19162c4d-2df5-4cae-8641-38f1c7fce0df]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:55 devstack sudo[87850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 Apr 13 11:03:55 devstack sudo[87850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:55 devstack sudo[87848]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" returned: 0 in 0.564s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:55 devstack sudo[87855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 1G Apr 13 11:03:55 devstack sudo[87855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:55 devstack sudo[87850]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37" returned: 0 in 0.578s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3160a211-9973-4868-a78a-395bd47b7edf]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-quobyte-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:56 devstack sudo[87860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[17075647-fa12-4e5a-8108-efefa9fa63f2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:56 devstack sudo[87860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:56 devstack sudo[87862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 Apr 13 11:03:56 devstack sudo[87862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:56 devstack sudo[87855]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 1G" returned: 0 in 0.647s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:56 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 Apr 13 11:03:56 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:56 devstack sudo[87860]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" returned: 0 in 0.595s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:56 devstack sudo[87875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 Apr 13 11:03:56 devstack sudo[87875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:56 devstack sudo[87862]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73" returned: 0 in 0.570s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:56 devstack sudo[87879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73 Apr 13 11:03:56 devstack sudo[87879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:56 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905" returned: 0 in 0.556s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:56 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:03:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:56 devstack sudo[87884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 Apr 13 11:03:56 devstack sudo[87884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:57 devstack sudo[87875]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37" returned: 0 in 0.566s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:57 devstack sudo[87890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37 Apr 13 11:03:57 devstack sudo[87890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:57 devstack sudo[87879]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73" returned: 0 in 0.545s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73" released by "delete_volume" :: held 1.138s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created reservations ['b9ed29ea-5beb-4241-835c-f122747dda39', '06afc785-8a78-4fc0-8f73-2e66f52ebd51', 'd5fb9b21-c38c-4d36-aa63-38aad13c6f0e', 'd73da688-435f-4e02-bd54-a594db0585b8'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:57 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:57 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:57 devstack sudo[87884]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905" returned: 0 in 0.483s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:57 devstack sudo[87895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.info Apr 13 11:03:57 devstack sudo[87895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:57 devstack sudo[87890]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6.149e9393-9b58-4324-9756-e6e44e1a4e37" returned: 0 in 0.512s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-149e9393-9b58-4324-9756-e6e44e1a4e37" released by "_delete_snapshot" :: held 2.321s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" released by "delete_snapshot" :: held 2.333s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created reservations ['44c64a1c-774d-4188-8ac3-000030432afe', '792f4949-3a19-4265-9554-dc88c726393d', '2bf17041-f900-43fb-b9a9-65261472a540', '0fd67f32-3d62-49be-8292-3cd56eae1b41'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:57 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Delete snapshot completed successfully. Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b687c25d-b2eb-4d8b-ac15-94103848c3ee tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-149e9393-9b58-4324-9756-e6e44e1a4e37-delete_snapshot" released by "delete_snapshot" :: held 2.432s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:57 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.515s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:57 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Deleted volume successfully. Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64d1b630-fb1e-4dfb-b6ae-a96226f85b0a tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-8e7584c5-1cfb-4e34-a1fc-89f569d9ac73-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:57 devstack sudo[87895]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.info" returned: 0 in 0.583s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:57 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:03:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:57 devstack sudo[87900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.info Apr 13 11:03:57 devstack sudo[87900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-161995f4-4749-4e95-9151-0a6e85e830a5-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-161995f4-4749-4e95-9151-0a6e85e830a5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-quobyte-161995f4-4749-4e95-9151-0a6e85e830a5" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-161995f4-4749-4e95-9151-0a6e85e830a5" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[532df400-89e8-4b15-84f9-af2e2c6228e1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:58 devstack sudo[87902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 Apr 13 11:03:58 devstack sudo[87902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:58 devstack sudo[87900]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.info" returned: 0 in 0.600s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.503s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Creating offline snapshot 9f6f088e-a92c-4f9f-b7e8-a70731a11390 of volume 63f1edf9-75b0-4bcb-8642-c4ce8d16da7f {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-7d23f45d-fdd6-4a8c-9d87-6994986a01e6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8379c738-ba78-4e2d-8197-624ef875c176]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-7d23f45d-fdd6-4a8c-9d87-6994986a01e6-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "cinder-quobyte-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a62056d8-0120-4d64-a3c7-a29e6e2cd0a5]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:58 devstack sudo[87905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f Apr 13 11:03:58 devstack sudo[87905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:58 devstack sudo[87906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 Apr 13 11:03:58 devstack sudo[87906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:58 devstack sudo[87902]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5" returned: 0 in 0.598s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:58 devstack sudo[87912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5 Apr 13 11:03:58 devstack sudo[87912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:59 devstack sudo[87905]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" returned: 0 in 0.585s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:59 devstack sudo[87920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 1G Apr 13 11:03:59 devstack sudo[87920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:59 devstack sudo[87906]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" returned: 0 in 0.551s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:59 devstack sudo[87923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6 Apr 13 11:03:59 devstack sudo[87923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:59 devstack sudo[87912]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-161995f4-4749-4e95-9151-0a6e85e830a5" returned: 0 in 0.473s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-161995f4-4749-4e95-9151-0a6e85e830a5" released by "delete_volume" :: held 1.097s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created reservations ['a7d94bad-073f-4229-8c43-b6c27ca8c6ae', '1cf73638-55cc-49c2-b187-50c294e5d27d', '0e0649fe-3df0-4f61-b9c3-a6590867f7e3', 'ed82f9ae-3cc2-49c2-8410-1296abff2b3f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:59 devstack sudo[87925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:03:59 devstack sudo[87925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:59 devstack sudo[87920]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 1G" returned: 0 in 0.600s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:03:59 devstack sudo[87930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 Apr 13 11:03:59 devstack sudo[87930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:03:59 devstack sudo[87923]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" returned: 0 in 0.670s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-quobyte-7d23f45d-fdd6-4a8c-9d87-6994986a01e6" released by "delete_volume" :: held 1.252s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:59 devstack sudo[87925]: pam_unix(sudo:session): session closed for user root Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.523s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:03:59 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Deleted volume successfully. Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Created reservations ['d6912618-701f-4f8c-85e6-335472e7a754', 'ca8966e0-ed2c-4c6b-8e94-99ff3dd1bbb2', '6b14a006-e015-42e7-9e99-f19be7c9f6f7', '2480f5af-d5f3-49a7-b966-8d45215204f7'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b32f6232-154d-448c-b76b-fc7667d3f971 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-161995f4-4749-4e95-9151-0a6e85e830a5-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:03:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:00 devstack sudo[87934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:00 devstack sudo[87934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:00 devstack sudo[87930]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390" returned: 0 in 0.537s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:00 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:00 devstack sudo[87939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 Apr 13 11:04:00 devstack sudo[87939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-9b0a56bf-4306-4801-91f2-7ee806a2e1da-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-9b0a56bf-4306-4801-91f2-7ee806a2e1da-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-quobyte-9b0a56bf-4306-4801-91f2-7ee806a2e1da" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-9b0a56bf-4306-4801-91f2-7ee806a2e1da" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[31520506-a1af-4dbe-871f-a2bb42b58bf7]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:00 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da Apr 13 11:04:00 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:00 devstack sudo[87934]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.698s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:00 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Deleted volume successfully. Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c1d83956-4f78-431a-919f-44a8e2ff88d5 tempest-CreateVolumesFromSnapshotTest-1949956827 None] Lock "cinder-7d23f45d-fdd6-4a8c-9d87-6994986a01e6-delete_volume" released by "delete_volume" :: held 2.091s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:00 devstack sudo[87939]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390" returned: 0 in 0.625s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:00 devstack sudo[87945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.info Apr 13 11:04:00 devstack sudo[87945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:01 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da" returned: 0 in 0.735s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:01 devstack sudo[87950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da Apr 13 11:04:01 devstack sudo[87950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:01 devstack sudo[87945]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.info" returned: 0 in 0.577s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:01 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:01 devstack sudo[87953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.info Apr 13 11:04:01 devstack sudo[87953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Flow 'volume_create_manager' (ac96385c-e6d0-4894-9ea7-ad8b2e263193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f57e45-7812-4c93-b3f0-3f57ab2c0a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f57e45-7812-4c93-b3f0-3f57ab2c0a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-939058079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7fc918-3fed-4d9e-b97a-e46c267183ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29f2e7785c74855ba272f49e2568d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:02Z,use_quota=True,user_id='4c1f4931e7ef47b8823261ca6e663ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20608acf-118b-4aac-a5ab-7f2e8016384e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20608acf-118b-4aac-a5ab-7f2e8016384e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208e5359-495d-4869-9db4-929517a6295f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208e5359-495d-4869-9db4-929517a6295f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ce7fc918-3fed-4d9e-b97a-e46c267183ba', 'volume_name': 'volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbd59bc-41ca-48af-8bda-5ed605e34937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dbd59bc-41ca-48af-8bda-5ed605e34937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac96bda9-f683-4959-a49c-1a1b9b70c86f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:01 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Volume ce7fc918-3fed-4d9e-b97a-e46c267183ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba', 'volume_size': 1} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:01 devstack sudo[87950]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9b0a56bf-4306-4801-91f2-7ee806a2e1da" returned: 0 in 0.629s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-9b0a56bf-4306-4801-91f2-7ee806a2e1da" released by "delete_volume" :: held 1.390s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created reservations ['4bc482d8-4004-4dda-a1f4-75249116d133', '90bbb17b-9891-4487-92cd-423aa12548e7', '2e856576-1441-483a-9ba5-573a69dd5b91', 'fb6c10c6-e53b-4236-8074-431f2e90ae0d'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:01 devstack sudo[87953]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.info" returned: 0 in 0.450s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:02 devstack sudo[87958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:02 devstack sudo[87958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.463s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-939058079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ce7fc918-3fed-4d9e-b97a-e46c267183ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b29f2e7785c74855ba272f49e2568d0b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:02Z,use_quota=True,user_id='4c1f4931e7ef47b8823261ca6e663ecf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Creating volume ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:04:02 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:02 devstack sudo[87960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba 1073741824 Apr 13 11:04:02 devstack sudo[87960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:02 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e4b6bd16-a9a4-491f-8505-b348b0591021 tempest-GroupSnapshotsTest-678215182 None] group_snapshot af782b8c-4ba8-4497-b7ac-ef3bbcacd2fd: created successfully Apr 13 11:04:02 devstack sudo[87958]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.455s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:02 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Deleted volume successfully. Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9c244d93-2d3f-4cc1-bbbb-1f82cb7f032c tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-9b0a56bf-4306-4801-91f2-7ee806a2e1da-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:02 devstack sudo[87960]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba 1073741824" returned: 0 in 0.513s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:02 devstack sudo[87966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:04:02 devstack sudo[87966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-0152f8fc-e56b-4994-8bb2-852b1f26fad6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-0152f8fc-e56b-4994-8bb2-852b1f26fad6-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-quobyte-0152f8fc-e56b-4994-8bb2-852b1f26fad6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-0152f8fc-e56b-4994-8bb2-852b1f26fad6" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8db514-eb4f-4b15-9f59-11933f30cd25]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:02 devstack sudo[87968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 Apr 13 11:04:02 devstack sudo[87968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:02 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] group_snapshot af782b8c-4ba8-4497-b7ac-ef3bbcacd2fd: deleting Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] group_snapshot af782b8c-4ba8-4497-b7ac-ef3bbcacd2fd: deleting {{(pid=82656) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-5bbe069b-934c-4ec1-ad40-d9317bc8a905" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-5bbe069b-934c-4ec1-ad40-d9317bc8a905" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Deleting offline snapshot 5bbe069b-934c-4ec1-ad40-d9317bc8a905 of volume 99230c3e-0a46-43cb-aecc-b7a4e9f4a410 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] snapshot_file for this snap is: volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c358348-38fd-41ff-90cb-a4fdeaa950c1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:02 devstack sudo[87970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 Apr 13 11:04:02 devstack sudo[87970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:03 devstack sudo[87966]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.486s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac96bda9-f683-4959-a49c-1a1b9b70c86f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89bf50d-bab1-4cb7-904c-515e5961157c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:03 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Volume volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba (ce7fc918-3fed-4d9e-b97a-e46c267183ba): created successfully Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f89bf50d-bab1-4cb7-904c-515e5961157c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Flow 'volume_create_manager' (ac96385c-e6d0-4894-9ea7-ad8b2e263193) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e4fcafc3-b4a4-4ce0-b5cd-8f77200009f6 tempest-VolumesActionsTest-436468360 None] Created volume successfully. Apr 13 11:04:03 devstack sudo[87968]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6" returned: 0 in 0.567s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:03 devstack sudo[87977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6 Apr 13 11:04:03 devstack sudo[87977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:03 devstack sudo[87970]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905" returned: 0 in 0.550s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d201c6a7-134a-4839-9f27-a163df1a3006]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:03 devstack sudo[87982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 Apr 13 11:04:03 devstack sudo[87982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:03 devstack sudo[87977]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0152f8fc-e56b-4994-8bb2-852b1f26fad6" returned: 0 in 0.474s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-0152f8fc-e56b-4994-8bb2-852b1f26fad6" released by "delete_volume" :: held 1.070s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created reservations ['b94542f5-0446-4f9a-a64a-333a0a6ad3d3', '096c4264-f572-4135-80a8-11c53e9f5cdd', 'f645479b-19ac-4623-a1e2-73e418b08287', 'c81a2fde-e435-4735-9d95-495890141a54'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:03 devstack sudo[87985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:03 devstack sudo[87985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:04 devstack sudo[87982]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" returned: 0 in 0.597s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:04 devstack sudo[87990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 Apr 13 11:04:04 devstack sudo[87990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:04 devstack sudo[87985]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.484s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:04 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Deleted volume successfully. Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-96ef03bd-d696-4054-a654-a0b1c1ffaf0f tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-0152f8fc-e56b-4994-8bb2-852b1f26fad6-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:04 devstack sudo[87990]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905" returned: 0 in 0.567s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:04 devstack sudo[87999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905 Apr 13 11:04:04 devstack sudo[87999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-40ec177a-da97-47d6-b1fd-b5fa91c8332c-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-40ec177a-da97-47d6-b1fd-b5fa91c8332c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=240,cinder:UPDATE=358,cinder:INSERT=75,cinder:DELETE=33 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-quobyte-40ec177a-da97-47d6-b1fd-b5fa91c8332c" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-40ec177a-da97-47d6-b1fd-b5fa91c8332c" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e07d80d-a5d6-4549-b131-cfe52dc20515]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:04 devstack sudo[88002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c Apr 13 11:04:04 devstack sudo[88002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:05 devstack sudo[87999]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410.5bbe069b-934c-4ec1-ad40-d9317bc8a905" returned: 0 in 0.484s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-5bbe069b-934c-4ec1-ad40-d9317bc8a905" released by "_delete_snapshot" :: held 2.248s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" released by "delete_snapshot" :: held 2.259s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-9f6f088e-a92c-4f9f-b7e8-a70731a11390" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-9f6f088e-a92c-4f9f-b7e8-a70731a11390" acquired by "_delete_snapshot" :: waited 0.005s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Deleting offline snapshot 9f6f088e-a92c-4f9f-b7e8-a70731a11390 of volume 63f1edf9-75b0-4bcb-8642-c4ce8d16da7f {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] snapshot_file for this snap is: volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[08acd55e-e36a-441e-b40f-1de55c1b82d3]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:05 devstack sudo[88005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 Apr 13 11:04:05 devstack sudo[88005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:05 devstack sudo[88002]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c" returned: 0 in 0.560s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:05 devstack sudo[88010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c Apr 13 11:04:05 devstack sudo[88010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:05 devstack sudo[88005]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390" returned: 0 in 0.494s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[51564b6c-5fc6-41c6-9e26-dffdb8cf163d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:05 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f Apr 13 11:04:05 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:05 devstack sudo[88010]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-40ec177a-da97-47d6-b1fd-b5fa91c8332c" returned: 0 in 0.413s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-40ec177a-da97-47d6-b1fd-b5fa91c8332c" released by "delete_volume" :: held 1.000s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created reservations ['a3ea08b6-0285-4169-8096-ae974850a989', 'f1bbc9db-1602-4d50-b053-1ebf17876cc9', '764a740a-6d8d-463d-a5d1-15af9e9a4623', 'de6e3421-38cc-49aa-b2f3-f094e34d7eb5'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:06 devstack sudo[88018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:06 devstack sudo[88018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:06 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:06 devstack sudo[88023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 Apr 13 11:04:06 devstack sudo[88023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:06 devstack sudo[88018]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.481s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:06 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:06 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Deleted volume successfully. Apr 13 11:04:06 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c422d594-2531-459c-b860-0dd78689c4f7 tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-40ec177a-da97-47d6-b1fd-b5fa91c8332c-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:06 devstack sudo[88023]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390" returned: 0 in 0.500s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:06 devstack sudo[88029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390 Apr 13 11:04:06 devstack sudo[88029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-fbe6e132-5193-47ea-90cd-6d8638acdc3a-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-fbe6e132-5193-47ea-90cd-6d8638acdc3a-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "cinder-quobyte-fbe6e132-5193-47ea-90cd-6d8638acdc3a" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-fbe6e132-5193-47ea-90cd-6d8638acdc3a" acquired by "delete_volume" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31160ab-1a97-4110-8a62-50e41b786baf]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:07 devstack sudo[88029]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f.9f6f088e-a92c-4f9f-b7e8-a70731a11390" returned: 0 in 0.433s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-9f6f088e-a92c-4f9f-b7e8-a70731a11390" released by "_delete_snapshot" :: held 1.996s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" released by "delete_snapshot" :: held 2.006s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:07 devstack sudo[88032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a Apr 13 11:04:07 devstack sudo[88032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:07 devstack cinder-volume[82656]: WARNING cinder.quota [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-148729549 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-148729549, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:07 devstack cinder-volume[82656]: WARNING cinder.quota [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-148729549 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-148729549, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Created reservations ['4d4c3f19-00a0-45a8-9bbf-6e3bfa3e1c95', 'bece54da-d06f-41d4-a5ec-d0a0fab7a4f1', '68fb7fdb-acbf-4425-95b1-9308deb38b5f', '38838376-80e5-469b-9956-23c27a21b745'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] Created reservations ['20f20ff0-caa9-487c-be5b-dd74a11eb745', 'c7340758-c8ef-415f-8904-9c4691d2919d', 'ecf83a32-a4f8-41e1-8125-a2ade4a08f37', 'fd5c348e-9718-41ea-84af-7e7551bfad72'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:07 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6cb9c8d7-5f0a-4ed6-bd5a-01ac554c700c tempest-GroupSnapshotsTest-678215182 None] group_snapshot af782b8c-4ba8-4497-b7ac-ef3bbcacd2fd: deleted successfully Apr 13 11:04:07 devstack sudo[88032]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a" returned: 0 in 0.522s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:07 devstack sudo[88037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a Apr 13 11:04:07 devstack sudo[88037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:08 devstack sudo[88037]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fbe6e132-5193-47ea-90cd-6d8638acdc3a" returned: 0 in 0.406s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-quobyte-fbe6e132-5193-47ea-90cd-6d8638acdc3a" released by "delete_volume" :: held 0.961s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Created reservations ['5e190a9d-7d30-47c2-a435-5160333b68fe', '686d5bd1-074b-40b8-8047-c669f22a48d6', '74edece7-6fc8-496b-a9b7-209cacee931b', '808b48e8-200f-4981-be84-c9b4d6447914'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:08 devstack sudo[88040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:08 devstack sudo[88040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d80639-59ee-4851-b9e7-4d20ba294847]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:08 devstack sudo[88042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f Apr 13 11:04:08 devstack sudo[88042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:08 devstack sudo[88040]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.570s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:08 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Deleted volume successfully. Apr 13 11:04:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bc45c17b-88ed-4f77-a74a-460e1d546d2e tempest-CreateVolumesFromSourceVolumeTest-95679664 None] Lock "cinder-fbe6e132-5193-47ea-90cd-6d8638acdc3a-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:09 devstack sudo[88042]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" returned: 0 in 0.646s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:09 devstack sudo[88048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f Apr 13 11:04:09 devstack sudo[88048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:09 devstack sudo[88048]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" returned: 0 in 0.536s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-63f1edf9-75b0-4bcb-8642-c4ce8d16da7f" released by "delete_volume" :: held 1.220s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:09 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cb8247e-f0ee-4b9e-aa51-357e9e18c1b3]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:09 devstack sudo[88051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 Apr 13 11:04:09 devstack sudo[88051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:10 devstack sudo[88051]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" returned: 0 in 0.616s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:10 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410 Apr 13 11:04:10 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Flow 'volume_create_manager' (09732282-abff-487c-86d9-4605ee7a106a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb46b58b-18d7-4041-8022-108a7ea8f307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb46b58b-18d7-4041-8022-108a7ea8f307) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a494576-e885-47ec-996c-bdd9687d6ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c43f7c56844f729f605846f61065b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:10Z,use_quota=True,user_id='c45e2ed937e34b62b6eaaa2ab3e5aad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af283e74-70d3-4c82-9a08-dc5a63be7fe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af283e74-70d3-4c82-9a08-dc5a63be7fe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84236c2-bbd2-4c1c-836c-c91f1da2fed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84236c2-bbd2-4c1c-836c-c91f1da2fed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a494576-e885-47ec-996c-bdd9687d6ceb', 'volume_name': 'volume-4a494576-e885-47ec-996c-bdd9687d6ceb', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6032f7e1-0dfa-4ffb-b489-00be5b49a561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6032f7e1-0dfa-4ffb-b489-00be5b49a561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227d4082-7660-4c93-a39e-d63f0011c56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:10 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Volume 4a494576-e885-47ec-996c-bdd9687d6ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a494576-e885-47ec-996c-bdd9687d6ceb', 'volume_size': 1} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:10Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a494576-e885-47ec-996c-bdd9687d6ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c43f7c56844f729f605846f61065b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:10Z,use_quota=True,user_id='c45e2ed937e34b62b6eaaa2ab3e5aad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Creating volume 4a494576-e885-47ec-996c-bdd9687d6ceb {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:04:10 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:10 devstack sudo[88059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb 1073741824 Apr 13 11:04:10 devstack sudo[88059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:10 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" returned: 0 in 0.543s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-99230c3e-0a46-43cb-aecc-b7a4e9f4a410" released by "delete_volume" :: held 1.188s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Created reservations ['7a125c08-92b1-4d9d-aaf0-a0e582f74af2'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:10 devstack cinder-volume[82656]: WARNING cinder.quota [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-148729549 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-148729549, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:10 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Created reservations ['f3891f5b-4108-4b98-9adb-d9c8f4c7dce6', '606643c5-55a3-4c27-b2ea-ab081210e7e8', 'ce703dce-f4ab-411d-afe6-a497ac6e95c9', 'a1e8013e-2ff1-4371-967c-aa672f31a2a6'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Created reservations ['df790ea5-ec55-4ebb-92af-05e73512d4dd', '54713c9c-ea45-413a-ad68-87804e5f6814', '6862c41a-20ec-4efd-b49b-ea3839ea073d', 'e7531339-712c-4deb-8aee-7e2b8d68807b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:11 devstack sudo[88059]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb 1073741824" returned: 0 in 0.581s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:11 devstack sudo[88081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:11 devstack sudo[88081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:11 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb Apr 13 11:04:11 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:11 devstack sudo[88081]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.443s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f5770acc-3b14-4e10-8c8d-2997b0c4891a tempest-GroupSnapshotsTest-678215182 None] Delete group completed successfully. Apr 13 11:04:11 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.118s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (227d4082-7660-4c93-a39e-d63f0011c56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a494576-e885-47ec-996c-bdd9687d6ceb', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7de935-4790-4a8a-81e0-7a8bd14a647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:11 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Volume volume-4a494576-e885-47ec-996c-bdd9687d6ceb (4a494576-e885-47ec-996c-bdd9687d6ceb): created successfully Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d7de935-4790-4a8a-81e0-7a8bd14a647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Flow 'volume_create_manager' (09732282-abff-487c-86d9-4605ee7a106a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-53fb79a6-0861-460d-9574-a17fdaf96a76 tempest-CinderUnicodeTest-1790507540 None] Created volume successfully. Apr 13 11:04:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f09b0cac-ef79-44dd-805e-1a666a745849 tempest-GroupSnapshotsTest-678215182 None] Group tempest-GroupSnapshotsTest-Group-1587669398: creating Apr 13 11:04:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f09b0cac-ef79-44dd-805e-1a666a745849 tempest-GroupSnapshotsTest-678215182 None] Group tempest-GroupSnapshotsTest-Group-1587669398: created successfully Apr 13 11:04:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f09b0cac-ef79-44dd-805e-1a666a745849 tempest-GroupSnapshotsTest-678215182 None] Create group completed successfully. Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Flow 'volume_create_manager' (fc595a73-352c-49b6-85ad-e20ffdcd4ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087b4a55-c59d-4fef-a589-4cc93226bbc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (087b4a55-c59d-4fef-a589-4cc93226bbc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2134328821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81bd4063-9b5a-4550-a439-35563309bf82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c43f7c56844f729f605846f61065b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:13Z,use_quota=True,user_id='c45e2ed937e34b62b6eaaa2ab3e5aad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff96e1ea-3931-49ce-b0e8-88371e483773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff96e1ea-3931-49ce-b0e8-88371e483773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6148d6af-cc41-4a75-a4e4-f8172720f4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6148d6af-cc41-4a75-a4e4-f8172720f4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81bd4063-9b5a-4550-a439-35563309bf82', 'volume_name': 'volume-81bd4063-9b5a-4550-a439-35563309bf82', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bde4d2-ae61-4f6d-82a5-dcbfe592e93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04bde4d2-ae61-4f6d-82a5-dcbfe592e93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda3eae9-1aad-475c-9985-51e6300a17d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:12 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Volume 81bd4063-9b5a-4550-a439-35563309bf82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81bd4063-9b5a-4550-a439-35563309bf82', 'volume_size': 1} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:13Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-2134328821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81bd4063-9b5a-4550-a439-35563309bf82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0c43f7c56844f729f605846f61065b0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:13Z,use_quota=True,user_id='c45e2ed937e34b62b6eaaa2ab3e5aad7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Creating volume 81bd4063-9b5a-4550-a439-35563309bf82 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:04:12 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:04:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:12 devstack sudo[88088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 1073741824 Apr 13 11:04:12 devstack sudo[88088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Flow 'volume_create_manager' (59937f42-9a91-491a-9b43-661b60ecf89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010302d2-dd28-4236-a796-8c38c90eec3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010302d2-dd28-4236-a796-8c38c90eec3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1597907450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=782cf070-d821-439b-9e87-7a5f28dbf9b3,host='devstack@QuobyteHD#QuobyteHD',id=d72c1a7d-2e80-458a-877d-714d65e34ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418d3141293d4cec8dd6dc4f342dc574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:13Z,use_quota=True,user_id='896e78490c70419680a741c693276de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8be30a0-7b66-4390-8ba2-6eed2c205847),volume_type_id=d8be30a0-7b66-4390-8ba2-6eed2c205847)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33e7b42-a115-4ef7-9484-4f42542c7bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33e7b42-a115-4ef7-9484-4f42542c7bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65636a2e-538f-4a90-9430-7208a62c5a56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65636a2e-538f-4a90-9430-7208a62c5a56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd72c1a7d-2e80-458a-877d-714d65e34ab6', 'volume_name': 'volume-d72c1a7d-2e80-458a-877d-714d65e34ab6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd418b4b-68be-49d8-8db9-d97f6beefb9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd418b4b-68be-49d8-8db9-d97f6beefb9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f063e2c1-0690-4894-9a06-05f78be539c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:13 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Volume d72c1a7d-2e80-458a-877d-714d65e34ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d72c1a7d-2e80-458a-877d-714d65e34ab6', 'volume_size': 1} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:13 devstack sudo[88088]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 1073741824" returned: 0 in 0.548s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:13 devstack sudo[88093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 Apr 13 11:04:13 devstack sudo[88093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:13 devstack sudo[88093]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82" returned: 0 in 0.439s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=782cf070-d821-439b-9e87-7a5f28dbf9b3,created_at=2026-04-13T09:04:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1597907450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=782cf070-d821-439b-9e87-7a5f28dbf9b3,host='devstack@QuobyteHD#QuobyteHD',id=d72c1a7d-2e80-458a-877d-714d65e34ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='418d3141293d4cec8dd6dc4f342dc574',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:13Z,use_quota=True,user_id='896e78490c70419680a741c693276de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d8be30a0-7b66-4390-8ba2-6eed2c205847),volume_type_id=d8be30a0-7b66-4390-8ba2-6eed2c205847)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Creating volume d72c1a7d-2e80-458a-877d-714d65e34ab6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:04:13 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda3eae9-1aad-475c-9985-51e6300a17d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81bd4063-9b5a-4550-a439-35563309bf82', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f668b48f-9261-42a0-9b79-657cbb4867bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:13 devstack sudo[88099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 1073741824 Apr 13 11:04:13 devstack sudo[88099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:13 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Volume volume-81bd4063-9b5a-4550-a439-35563309bf82 (81bd4063-9b5a-4550-a439-35563309bf82): created successfully Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f668b48f-9261-42a0-9b79-657cbb4867bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Flow 'volume_create_manager' (fc595a73-352c-49b6-85ad-e20ffdcd4ab2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:13 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c54028d5-bbb1-4864-99eb-369e327ed8f6 tempest-CinderUnicodeTest-1790507540 None] Created volume successfully. Apr 13 11:04:14 devstack sudo[88099]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 1073741824" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:14 devstack sudo[88104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 Apr 13 11:04:14 devstack sudo[88104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:14 devstack sudo[88104]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6" returned: 0 in 0.468s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f063e2c1-0690-4894-9a06-05f78be539c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d72c1a7d-2e80-458a-877d-714d65e34ab6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6e0ed9-afa4-47c1-9faa-43bf7004a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:14 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Volume volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 (d72c1a7d-2e80-458a-877d-714d65e34ab6): created successfully Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b6e0ed9-afa4-47c1-9faa-43bf7004a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Flow 'volume_create_manager' (59937f42-9a91-491a-9b43-661b60ecf89f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:14 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5608028e-f378-48f9-b4bd-657323c54407 tempest-GroupSnapshotsTest-678215182 None] Created volume successfully. Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Creating offline snapshot ceb599dd-3e41-4530-a456-92809d11aa8c of volume 81bd4063-9b5a-4550-a439-35563309bf82 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[210856ad-454c-4bad-9651-7d16f9f4ab5e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:15 devstack sudo[88107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 Apr 13 11:04:15 devstack sudo[88107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:15 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] GroupSnapshot 2ec11519-af6d-4354-8b42-5efca291cac6: creating. Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Group snapshot 2ec11519-af6d-4354-8b42-5efca291cac6: creating. {{(pid=82656) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:15 devstack sudo[88107]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82" returned: 0 in 0.765s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:15 devstack sudo[88138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c 1G Apr 13 11:04:15 devstack sudo[88138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:16 devstack sudo[88138]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c 1G" returned: 0 in 0.608s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bd4063-9b5a-4550-a439-35563309bf82 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:16 devstack sudo[88145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bd4063-9b5a-4550-a439-35563309bf82 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c Apr 13 11:04:16 devstack sudo[88145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:16 devstack sudo[88145]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-81bd4063-9b5a-4550-a439-35563309bf82 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c" returned: 0 in 0.464s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:16 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c is being set with open permissions: ugo+rw Apr 13 11:04:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:17 devstack sudo[88150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c Apr 13 11:04:17 devstack sudo[88150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-61952e8a-4dcd-47b4-a3e5-98f3589a5f03 tempest-VolumesActionsTest-436468360 None] Acquiring lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba" by "attach_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-61952e8a-4dcd-47b4-a3e5-98f3589a5f03 tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba" acquired by "attach_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:17 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-61952e8a-4dcd-47b4-a3e5-98f3589a5f03 tempest-VolumesActionsTest-436468360 None] Attaching volume ce7fc918-3fed-4d9e-b97a-e46c267183ba to instance 38ef608c-f4ec-4337-bffa-fcecff958807 at mountpoint /dev/vdb on host None. Apr 13 11:04:17 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-61952e8a-4dcd-47b4-a3e5-98f3589a5f03 tempest-VolumesActionsTest-436468360 None] Attach volume completed successfully. Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-61952e8a-4dcd-47b4-a3e5-98f3589a5f03 tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba" released by "attach_volume" :: held 0.065s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:17 devstack sudo[88150]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c" returned: 0 in 0.475s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:17 devstack sudo[88153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.info Apr 13 11:04:17 devstack sudo[88153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-40b46b7e-fb29-4979-b9e1-027c7338b1aa tempest-VolumesActionsTest-436468360 None] Acquiring lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-detach_volume" by "detach_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-40b46b7e-fb29-4979-b9e1-027c7338b1aa tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-detach_volume" acquired by "detach_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:17 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-40b46b7e-fb29-4979-b9e1-027c7338b1aa tempest-VolumesActionsTest-436468360 None] Detaching volume ce7fc918-3fed-4d9e-b97a-e46c267183ba from instance 38ef608c-f4ec-4337-bffa-fcecff958807. Apr 13 11:04:17 devstack sudo[88153]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.info" returned: 0 in 0.473s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:17 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.info is being set with open permissions: ugo+rw Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:17 devstack sudo[88156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.info Apr 13 11:04:17 devstack sudo[88156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:17 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-40b46b7e-fb29-4979-b9e1-027c7338b1aa tempest-VolumesActionsTest-436468360 None] Detach volume completed successfully. Apr 13 11:04:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-40b46b7e-fb29-4979-b9e1-027c7338b1aa tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:18 devstack sudo[88156]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.info" returned: 0 in 0.443s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.290s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.689s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Creating offline snapshot 6476c6cb-a0be-4151-8301-431f9e33c2c3 of volume d72c1a7d-2e80-458a-877d-714d65e34ab6 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:04:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b3d4714d-15db-4582-9b96-dec31aed1d91 tempest-CinderUnicodeTest-1790507540 None] Create snapshot completed successfully Apr 13 11:04:18 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8fc9343-1e0b-4f5e-8496-4000cc254d80]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:18 devstack sudo[88159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 Apr 13 11:04:18 devstack sudo[88159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:18 devstack sudo[88159]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6" returned: 0 in 0.514s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:18 devstack sudo[88166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 1G Apr 13 11:04:18 devstack sudo[88166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "cinder-ceb599dd-3e41-4530-a456-92809d11aa8c-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-ceb599dd-3e41-4530-a456-92809d11aa8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "cinder-quobyte-81bd4063-9b5a-4550-a439-35563309bf82" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-quobyte-81bd4063-9b5a-4550-a439-35563309bf82" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "cinder-quobyte-ceb599dd-3e41-4530-a456-92809d11aa8c" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-quobyte-ceb599dd-3e41-4530-a456-92809d11aa8c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Deleting offline snapshot ceb599dd-3e41-4530-a456-92809d11aa8c of volume 81bd4063-9b5a-4550-a439-35563309bf82 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] snapshot_file for this snap is: volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a623f609-77cb-4583-b76c-7dd227e4d59d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:19 devstack sudo[88171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c Apr 13 11:04:19 devstack sudo[88171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:19 devstack sudo[88166]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 1G" returned: 0 in 0.570s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:19 devstack sudo[88173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 Apr 13 11:04:19 devstack sudo[88173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:19 devstack sudo[88171]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c" returned: 0 in 0.601s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-81bd4063-9b5a-4550-a439-35563309bf82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f909caf-d1a6-4a7b-9e2b-8e8bf5644ede]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:20 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 Apr 13 11:04:20 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:20 devstack sudo[88173]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3" returned: 0 in 0.600s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:20 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:04:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:20 devstack sudo[88207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 Apr 13 11:04:20 devstack sudo[88207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:20 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82" returned: 0 in 0.535s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:20 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c Apr 13 11:04:20 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:20 devstack sudo[88207]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:20 devstack sudo[88216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.info Apr 13 11:04:20 devstack sudo[88216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:20 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c" returned: 0 in 0.492s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:21 devstack sudo[88223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c Apr 13 11:04:21 devstack sudo[88223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:21 devstack sudo[88216]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.info" returned: 0 in 0.452s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:21 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:21 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.info Apr 13 11:04:21 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:21 devstack sudo[88223]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82.ceb599dd-3e41-4530-a456-92809d11aa8c" returned: 0 in 0.467s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-quobyte-ceb599dd-3e41-4530-a456-92809d11aa8c" released by "_delete_snapshot" :: held 2.164s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-quobyte-81bd4063-9b5a-4550-a439-35563309bf82" released by "delete_snapshot" :: held 2.182s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Created reservations ['a56f6a25-0f70-4e12-9a0f-8770275320de', '87b0875a-55ca-4d64-93ad-0dc79638d251', '5b203cdb-d70b-454b-a17b-1bb57e79f7b8', '31338232-74a8-42e8-9001-f7a80ade5b87'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:21 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.info" returned: 0 in 0.483s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.174s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:21 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Delete snapshot completed successfully. Apr 13 11:04:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-537f6b04-926d-4d6f-b7bc-3287caf52b2c tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-ceb599dd-3e41-4530-a456-92809d11aa8c-delete_snapshot" released by "delete_snapshot" :: held 2.288s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:21 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-91fa9753-908f-43e1-b006-288f9a738333 tempest-GroupSnapshotsTest-678215182 None] group_snapshot 2ec11519-af6d-4354-8b42-5efca291cac6: created successfully Apr 13 11:04:22 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] group_snapshot 2ec11519-af6d-4354-8b42-5efca291cac6: deleting Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] group_snapshot 2ec11519-af6d-4354-8b42-5efca291cac6: deleting {{(pid=82656) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-d72c1a7d-2e80-458a-877d-714d65e34ab6" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-d72c1a7d-2e80-458a-877d-714d65e34ab6" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-6476c6cb-a0be-4151-8301-431f9e33c2c3" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-6476c6cb-a0be-4151-8301-431f9e33c2c3" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Deleting offline snapshot 6476c6cb-a0be-4151-8301-431f9e33c2c3 of volume d72c1a7d-2e80-458a-877d-714d65e34ab6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] snapshot_file for this snap is: volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e888282-6e0c-43b1-94ec-4da90a9e92ae]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:22 devstack sudo[88237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 Apr 13 11:04:22 devstack sudo[88237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "cinder-81bd4063-9b5a-4550-a439-35563309bf82-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-81bd4063-9b5a-4550-a439-35563309bf82-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "cinder-quobyte-81bd4063-9b5a-4550-a439-35563309bf82" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-quobyte-81bd4063-9b5a-4550-a439-35563309bf82" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7a5972-a1d2-4b04-be9c-9087fb257b5e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:22 devstack sudo[88239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 Apr 13 11:04:22 devstack sudo[88239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:22 devstack sudo[88237]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3" returned: 0 in 0.530s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d72c1a7d-2e80-458a-877d-714d65e34ab6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[22406fea-9e5e-4061-a1a5-475add8a7fcc]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:22 devstack sudo[88244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 Apr 13 11:04:22 devstack sudo[88244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:23 devstack sudo[88239]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82" returned: 0 in 0.512s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:23 devstack sudo[88249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82 Apr 13 11:04:23 devstack sudo[88249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:23 devstack sudo[88244]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6" returned: 0 in 0.536s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:23 devstack sudo[88254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 Apr 13 11:04:23 devstack sudo[88254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:23 devstack sudo[88249]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-81bd4063-9b5a-4550-a439-35563309bf82" returned: 0 in 0.475s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-quobyte-81bd4063-9b5a-4550-a439-35563309bf82" released by "delete_volume" :: held 1.019s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Created reservations ['6ce4e084-8cac-4fbb-98da-c8bc0ddb0be4', 'c2d60230-8edd-4d55-8392-6af0457bf52d', '4c49e483-a63d-4783-b8d3-c641ee707b26', 'c8c324ba-e727-4a0d-bf39-47622d542b4f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:23 devstack sudo[88260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:23 devstack sudo[88260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:23 devstack sudo[88254]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3" returned: 0 in 0.493s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:23 devstack sudo[88262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3 Apr 13 11:04:23 devstack sudo[88262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:24 devstack sudo[88260]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:24 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Deleted volume successfully. Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-c3e7a410-fe7f-4caa-91c4-96d64b82221b tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-81bd4063-9b5a-4550-a439-35563309bf82-delete_volume" released by "delete_volume" :: held 1.660s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:24 devstack sudo[88262]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6.6476c6cb-a0be-4151-8301-431f9e33c2c3" returned: 0 in 0.475s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-6476c6cb-a0be-4151-8301-431f9e33c2c3" released by "_delete_snapshot" :: held 2.091s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-d72c1a7d-2e80-458a-877d-714d65e34ab6" released by "delete_snapshot" :: held 2.103s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:24 devstack cinder-volume[82656]: WARNING cinder.quota [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-255333807 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-255333807, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:24 devstack cinder-volume[82656]: WARNING cinder.quota [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-255333807 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-255333807, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] Created reservations ['96f8b559-b2d9-49ec-b7f5-93c5dd8b17cd', '0e8addff-abb5-459c-8f85-27c94e726f86', '5a667c65-b817-45ab-8cd8-61232b0aab3d', '95f91f29-8222-46a1-adf9-6a84afb497ba'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:24 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0b5c046f-11b3-416f-8826-e668e5d95835 tempest-GroupSnapshotsTest-678215182 None] group_snapshot 2ec11519-af6d-4354-8b42-5efca291cac6: deleted successfully Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "cinder-4a494576-e885-47ec-996c-bdd9687d6ceb-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-4a494576-e885-47ec-996c-bdd9687d6ceb-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "cinder-quobyte-4a494576-e885-47ec-996c-bdd9687d6ceb" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-quobyte-4a494576-e885-47ec-996c-bdd9687d6ceb" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3296bd00-e43b-4f69-9019-652b859eb053]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:24 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb Apr 13 11:04:24 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:25 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb" returned: 0 in 0.554s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:25 devstack sudo[88274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb Apr 13 11:04:25 devstack sudo[88274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "cinder-quobyte-d72c1a7d-2e80-458a-877d-714d65e34ab6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-d72c1a7d-2e80-458a-877d-714d65e34ab6" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:25 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[562ae3fe-4c6c-41f6-bed1-e969ddbe093d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:25 devstack sudo[88276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 Apr 13 11:04:25 devstack sudo[88276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:25 devstack sudo[88274]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4a494576-e885-47ec-996c-bdd9687d6ceb" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-quobyte-4a494576-e885-47ec-996c-bdd9687d6ceb" released by "delete_volume" :: held 1.115s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:26 devstack sudo[88276]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6" returned: 0 in 0.507s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:26 devstack sudo[88282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6 Apr 13 11:04:26 devstack sudo[88282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:26 devstack sudo[88282]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d72c1a7d-2e80-458a-877d-714d65e34ab6" returned: 0 in 0.423s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Lock "cinder-quobyte-d72c1a7d-2e80-458a-877d-714d65e34ab6" released by "delete_volume" :: held 0.961s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:26 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Created reservations ['c720e443-4ca6-4b28-b847-b4b999196d24', '60c76c73-6e79-45d7-be1d-f8177806824d', 'ea7744c6-2a40-4b5c-9a2a-7e2a60b1eb23', 'af8a3b09-c15f-418a-b71a-d26f8af9da11'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:27 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:27 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Created reservations ['9bf6b7a7-5870-4a00-a90a-cc07f044f4c0'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:27 devstack cinder-volume[82656]: WARNING cinder.quota [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-255333807 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-255333807, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Created reservations ['c2c67840-57f2-4a3c-b89e-89f31ac3f28f', 'd4751786-b83c-4fb8-a29a-04b9e4a0a5dd', '1282ba06-854f-4823-a279-69f42df9f0a0', '9f137272-91a7-40f9-b7f4-ed964aafd444'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:27 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.452s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:27 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:27 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Deleted volume successfully. Apr 13 11:04:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-327893f6-8c10-41cd-9e91-d71310ef3bc7 tempest-CinderUnicodeTest-1790507540 None] Lock "cinder-4a494576-e885-47ec-996c-bdd9687d6ceb-delete_volume" released by "delete_volume" :: held 3.584s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:32 devstack sudo[88290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:32 devstack sudo[88290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:32 devstack sudo[88290]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.484s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:32 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:32 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-dd344590-8c3a-499d-9fd4-d6570a2955de tempest-GroupSnapshotsTest-678215182 None] Delete group completed successfully. Apr 13 11:04:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-fa7de567-e124-46c6-8929-416b858ebe81 tempest-GroupSnapshotsV319Test-36316584 None] Group tempest-GroupSnapshotsV319Test-Group-1488659392: creating Apr 13 11:04:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-fa7de567-e124-46c6-8929-416b858ebe81 tempest-GroupSnapshotsV319Test-36316584 None] Group tempest-GroupSnapshotsV319Test-Group-1488659392: created successfully Apr 13 11:04:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-fa7de567-e124-46c6-8929-416b858ebe81 tempest-GroupSnapshotsV319Test-36316584 None] Create group completed successfully. Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Flow 'volume_create_manager' (72cbe6bc-f0b1-4571-8ac4-5eae92ddb7d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459ebb35-34d5-4a0e-9447-802d404a4587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (459ebb35-34d5-4a0e-9447-802d404a4587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2032093265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b007df0d-79e5-4a7f-a4a2-30fd017d8d3b,host='devstack@QuobyteHD#QuobyteHD',id=c5a931d5-2402-4705-a440-d47a19463846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19485f3fba724e9d86e1348614669d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:37Z,use_quota=True,user_id='51cbe02082f149b5b633fb1423c3e45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e84af0fe-f728-4f78-a817-ebf208c0a618),volume_type_id=e84af0fe-f728-4f78-a817-ebf208c0a618)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325b0757-ac57-4992-ac99-8ac7182c837a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (325b0757-ac57-4992-ac99-8ac7182c837a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd49a407-88ac-4136-b47f-66e7898f8ba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd49a407-88ac-4136-b47f-66e7898f8ba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5a931d5-2402-4705-a440-d47a19463846', 'volume_name': 'volume-c5a931d5-2402-4705-a440-d47a19463846', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2794cc24-27cc-4b32-b0b6-7e3f602e09b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2794cc24-27cc-4b32-b0b6-7e3f602e09b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50431b5-81ed-431b-972b-658ca3cab03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:37 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Volume c5a931d5-2402-4705-a440-d47a19463846: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5a931d5-2402-4705-a440-d47a19463846', 'volume_size': 1} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b007df0d-79e5-4a7f-a4a2-30fd017d8d3b,created_at=2026-04-13T09:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2032093265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b007df0d-79e5-4a7f-a4a2-30fd017d8d3b,host='devstack@QuobyteHD#QuobyteHD',id=c5a931d5-2402-4705-a440-d47a19463846,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19485f3fba724e9d86e1348614669d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:37Z,use_quota=True,user_id='51cbe02082f149b5b633fb1423c3e45c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e84af0fe-f728-4f78-a817-ebf208c0a618),volume_type_id=e84af0fe-f728-4f78-a817-ebf208c0a618)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Creating volume c5a931d5-2402-4705-a440-d47a19463846 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:04:37 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:04:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:37 devstack sudo[88301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 1073741824 Apr 13 11:04:37 devstack sudo[88301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:38 devstack sudo[88301]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 1073741824" returned: 0 in 0.505s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:38 devstack sudo[88314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 Apr 13 11:04:38 devstack sudo[88314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:38 devstack sudo[88314]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846" returned: 0 in 0.452s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] <== create_volume: return (986ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50431b5-81ed-431b-972b-658ca3cab03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5a931d5-2402-4705-a440-d47a19463846', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b39d60b-d77f-4a1d-872a-7fd1d55ef977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Volume volume-c5a931d5-2402-4705-a440-d47a19463846 (c5a931d5-2402-4705-a440-d47a19463846): created successfully Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b39d60b-d77f-4a1d-872a-7fd1d55ef977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Flow 'volume_create_manager' (72cbe6bc-f0b1-4571-8ac4-5eae92ddb7d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:38 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-cd912f3e-3244-4b8a-ba51-d7edc6847a8c tempest-GroupSnapshotsV319Test-36316584 None] Created volume successfully. Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:38 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:38 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:39 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.447s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] GroupSnapshot b18d0cb5-ebe9-4b40-ac42-981bda935c90: creating. Apr 13 11:04:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Group snapshot b18d0cb5-ebe9-4b40-ac42-981bda935c90: creating. {{(pid=82656) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Apr 13 11:04:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Creating offline snapshot 946dfee2-29ac-49bd-a1ab-f37827dd7035 of volume c5a931d5-2402-4705-a440-d47a19463846 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:04:39 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[36222b0c-44d7-4114-b224-606ac0f245e8]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:39 devstack sudo[88354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 Apr 13 11:04:39 devstack sudo[88354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:40 devstack sudo[88354]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846" returned: 0 in 0.546s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:40 devstack sudo[88362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 1G Apr 13 11:04:40 devstack sudo[88362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:40 devstack sudo[88362]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 1G" returned: 0 in 0.483s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a931d5-2402-4705-a440-d47a19463846 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:40 devstack sudo[88367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a931d5-2402-4705-a440-d47a19463846 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 Apr 13 11:04:40 devstack sudo[88367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:41 devstack sudo[88367]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5a931d5-2402-4705-a440-d47a19463846 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:41 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:04:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:41 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 Apr 13 11:04:41 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:41 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035" returned: 0 in 0.487s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:41 devstack sudo[88404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.info Apr 13 11:04:41 devstack sudo[88404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:42 devstack sudo[88404]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.info" returned: 0 in 0.559s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:42 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.info is being set with open permissions: ugo+rw: NotImplementedError Apr 13 11:04:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:42 devstack sudo[88409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.info Apr 13 11:04:42 devstack sudo[88409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:42 devstack sudo[88409]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.info" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.121s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e3d52ac2-7b91-40a2-b33f-6ffa23d5f24a tempest-GroupSnapshotsV319Test-36316584 None] group_snapshot b18d0cb5-ebe9-4b40-ac42-981bda935c90: created successfully Apr 13 11:04:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0cee2643-84a5-4650-b5ed-d7f0bc940ec5 tempest-VolumesActionsTest-436468360 None] Acquiring lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba" by "attach_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0cee2643-84a5-4650-b5ed-d7f0bc940ec5 tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba" acquired by "attach_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0cee2643-84a5-4650-b5ed-d7f0bc940ec5 tempest-VolumesActionsTest-436468360 None] Attaching volume ce7fc918-3fed-4d9e-b97a-e46c267183ba to instance 4e3b926e-87f0-4461-a9bb-b1d9db12983f at mountpoint /dev/vdb on host None. Apr 13 11:04:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0cee2643-84a5-4650-b5ed-d7f0bc940ec5 tempest-VolumesActionsTest-436468360 None] Attach volume completed successfully. Apr 13 11:04:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-0cee2643-84a5-4650-b5ed-d7f0bc940ec5 tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba" released by "attach_volume" :: held 0.070s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:44 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] group_snapshot b18d0cb5-ebe9-4b40-ac42-981bda935c90: deleting Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] group_snapshot b18d0cb5-ebe9-4b40-ac42-981bda935c90: deleting {{(pid=82656) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Acquiring lock "cinder-quobyte-c5a931d5-2402-4705-a440-d47a19463846" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Lock "cinder-quobyte-c5a931d5-2402-4705-a440-d47a19463846" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Acquiring lock "cinder-quobyte-946dfee2-29ac-49bd-a1ab-f37827dd7035" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Lock "cinder-quobyte-946dfee2-29ac-49bd-a1ab-f37827dd7035" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Deleting offline snapshot 946dfee2-29ac-49bd-a1ab-f37827dd7035 of volume c5a931d5-2402-4705-a440-d47a19463846 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] snapshot_file for this snap is: volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[34d47608-fe90-48cd-9d2c-5a50504033f0]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:44 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 Apr 13 11:04:44 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b91d7524-18b8-40db-a41b-74d94afdbcc1 tempest-VolumesActionsTest-436468360 None] Acquiring lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-detach_volume" by "detach_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b91d7524-18b8-40db-a41b-74d94afdbcc1 tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-detach_volume" acquired by "detach_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:44 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b91d7524-18b8-40db-a41b-74d94afdbcc1 tempest-VolumesActionsTest-436468360 None] Detaching volume ce7fc918-3fed-4d9e-b97a-e46c267183ba from instance 4e3b926e-87f0-4461-a9bb-b1d9db12983f. Apr 13 11:04:44 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b91d7524-18b8-40db-a41b-74d94afdbcc1 tempest-VolumesActionsTest-436468360 None] Detach volume completed successfully. Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b91d7524-18b8-40db-a41b-74d94afdbcc1 tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:44 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035" returned: 0 in 0.510s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5a931d5-2402-4705-a440-d47a19463846(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a74a9988-e840-40db-b0b7-1d35f4c983ee]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:44 devstack sudo[88417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 Apr 13 11:04:44 devstack sudo[88417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:45 devstack sudo[88417]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846" returned: 0 in 0.531s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:45 devstack sudo[88423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 Apr 13 11:04:45 devstack sudo[88423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:45 devstack sudo[88423]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035" returned: 0 in 0.456s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:45 devstack sudo[88428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035 Apr 13 11:04:45 devstack sudo[88428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:46 devstack sudo[88428]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846.946dfee2-29ac-49bd-a1ab-f37827dd7035" returned: 0 in 0.452s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Lock "cinder-quobyte-946dfee2-29ac-49bd-a1ab-f37827dd7035" released by "_delete_snapshot" :: held 2.077s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Lock "cinder-quobyte-c5a931d5-2402-4705-a440-d47a19463846" released by "delete_snapshot" :: held 2.090s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:46 devstack cinder-volume[82656]: WARNING cinder.quota [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1666685660 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1666685660, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:46 devstack cinder-volume[82656]: WARNING cinder.quota [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1666685660 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1666685660, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:46 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] Created reservations ['4ad1e5c1-d5a1-4be7-9f3c-cab1723f44d3', '2cbf8d10-0126-4a59-aaec-abb9e8c9646a', 'ba53ef49-28c6-4db9-b510-c1bc79f6f09c', 'cbf9ebc8-6c83-4d6e-8a17-276e8192324a'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:46 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4fe5f005-3034-48e0-8092-d97cb18fa147 tempest-GroupSnapshotsV319Test-36316584 None] group_snapshot b18d0cb5-ebe9-4b40-ac42-981bda935c90: deleted successfully Apr 13 11:04:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Acquiring lock "cinder-quobyte-c5a931d5-2402-4705-a440-d47a19463846" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:04:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Lock "cinder-quobyte-c5a931d5-2402-4705-a440-d47a19463846" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:04:47 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[97ec1131-e537-45db-b0d6-6283e5648d43]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:47 devstack sudo[88459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 Apr 13 11:04:47 devstack sudo[88459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:48 devstack sudo[88459]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846" returned: 0 in 0.500s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:48 devstack sudo[88465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846 Apr 13 11:04:48 devstack sudo[88465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:48 devstack sudo[88465]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c5a931d5-2402-4705-a440-d47a19463846" returned: 0 in 0.417s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Lock "cinder-quobyte-c5a931d5-2402-4705-a440-d47a19463846" released by "delete_volume" :: held 0.953s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Created reservations ['f2cbf598-8098-4371-a6bc-11f99f371e31'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:48 devstack cinder-volume[82656]: WARNING cinder.quota [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1666685660 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1666685660, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Created reservations ['6c186d20-61f3-47ef-8e98-8af156c5a5d3', '6f534f76-7f91-4795-8d35-347d6a2205cb', '2def984b-9cd0-4c65-a484-5be081d993e1', '8d2a6d53-163e-4bd8-bf97-0835b4076c5c'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:04:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:48 devstack sudo[88468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:04:48 devstack sudo[88468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:49 devstack sudo[88468]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.439s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:49 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:04:49 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ccfa755a-d1e5-4890-a5b8-ba8931cf4d05 tempest-GroupSnapshotsV319Test-36316584 None] Delete group completed successfully. Apr 13 11:04:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:04:52 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8fc42c-8028-4417-a0ad-7125a923e785]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:52 devstack sudo[88472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:04:52 devstack sudo[88472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:52 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f1fcac7f-6c69-4a26-affa-5fdbc99d9e13 tempest-GroupsTest-468509995 None] Group tempest-Group1-973885320: creating Apr 13 11:04:52 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f1fcac7f-6c69-4a26-affa-5fdbc99d9e13 tempest-GroupsTest-468509995 None] Group tempest-Group1-973885320: created successfully Apr 13 11:04:52 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f1fcac7f-6c69-4a26-affa-5fdbc99d9e13 tempest-GroupsTest-468509995 None] Create group completed successfully. Apr 13 11:04:52 devstack sudo[88472]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.512s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:52 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[369c9d3e-8f09-4cee-ac77-85287a91a9d8]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:52 devstack sudo[88477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:04:52 devstack sudo[88477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:53 devstack sudo[88477]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.464s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.d55135a7-fb99-4ff4-9bc5-2fed259fe2dchcrjys05.img {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:53 devstack sudo[88482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.d55135a7-fb99-4ff4-9bc5-2fed259fe2dchcrjys05.img Apr 13 11:04:53 devstack sudo[88482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0a5878f6-a195-4275-a094-4f9e573d218e tempest-GroupsTest-468509995 None] Group tempest-Group2-921244672: creating Apr 13 11:04:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0a5878f6-a195-4275-a094-4f9e573d218e tempest-GroupsTest-468509995 None] Group tempest-Group2-921244672: created successfully Apr 13 11:04:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0a5878f6-a195-4275-a094-4f9e573d218e tempest-GroupsTest-468509995 None] Create group completed successfully. Apr 13 11:04:55 devstack sudo[88482]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.d55135a7-fb99-4ff4-9bc5-2fed259fe2dchcrjys05.img" returned: 0 in 1.931s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5f5805-a66f-4fde-bf09-975ee51dd736]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:04:55 devstack sudo[88494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:04:55 devstack sudo[88494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=162,cinder:INSERT=43,cinder:UPDATE=187,cinder:DELETE=6 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Flow 'volume_create_manager' (b0b13bbc-b160-4d82-aea7-1d344d715ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8007c23-e03a-4921-8ea6-4982a24f9426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8007c23-e03a-4921-8ea6-4982a24f9426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-449718227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53abf4f8-d19f-4e29-b146-b944fca29861,host='devstack@QuobyteHD#QuobyteHD',id=bb762ee9-a656-40ce-9996-ff2cfd0d209e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747bc244b1c453aadaccf1775f17aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:55Z,use_quota=True,user_id='e7119d20ba004fdba93e3601f64ec860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97ab1b03-e713-43bd-a492-d59a819528e4),volume_type_id=97ab1b03-e713-43bd-a492-d59a819528e4)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0378ee2-eb6a-4c43-a602-99cce0004abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0378ee2-eb6a-4c43-a602-99cce0004abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2549909-6e79-4178-b5de-faae7390561a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2549909-6e79-4178-b5de-faae7390561a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb762ee9-a656-40ce-9996-ff2cfd0d209e', 'volume_name': 'volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e160706-358b-4fb9-afed-ddfd4a7519fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e160706-358b-4fb9-afed-ddfd4a7519fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1fbd8a-0e37-4bfc-b1c0-f3dde3aa2c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:04:55 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Volume bb762ee9-a656-40ce-9996-ff2cfd0d209e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e', 'volume_size': 1} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:04:55 devstack sudo[88494]: pam_unix(sudo:session): session closed for user root Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.624s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.d55135a7-fb99-4ff4-9bc5-2fed259fe2dchcrjys05.img {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:04:55 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Converted 1024.00 MB image at 529.93 MB/s Apr 13 11:04:55 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] d55135a7-fb99-4ff4-9bc5-2fed259fe2dc was raw, no need to convert to raw {{(pid=82656) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1159}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.201s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Uploaded volume to glance image-id: d55135a7-fb99-4ff4-9bc5-2fed259fe2dc. {{(pid=82656) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.063s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=53abf4f8-d19f-4e29-b146-b944fca29861,created_at=2026-04-13T09:04:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-449718227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=53abf4f8-d19f-4e29-b146-b944fca29861,host='devstack@QuobyteHD#QuobyteHD',id=bb762ee9-a656-40ce-9996-ff2cfd0d209e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747bc244b1c453aadaccf1775f17aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:04:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:04:55Z,use_quota=True,user_id='e7119d20ba004fdba93e3601f64ec860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(97ab1b03-e713-43bd-a492-d59a819528e4),volume_type_id=97ab1b03-e713-43bd-a492-d59a819528e4)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Creating volume bb762ee9-a656-40ce-9996-ff2cfd0d209e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:05 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:05 devstack sudo[88501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e 1073741824 Apr 13 11:05:05 devstack sudo[88501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-49e07b07-bb20-4489-bd25-7eea9052c8d8 tempest-VolumesActionsTest-436468360 None] Copy volume to image completed successfully. Apr 13 11:05:05 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=132,cinder:INSERT=38,cinder:UPDATE=121,cinder:DELETE=6 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:05:06 devstack sudo[88501]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e 1073741824" returned: 0 in 0.530s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:06 devstack sudo[88506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e Apr 13 11:05:06 devstack sudo[88506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:06 devstack sudo[88506]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e" returned: 0 in 0.438s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.243s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd1fbd8a-0e37-4bfc-b1c0-f3dde3aa2c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030c9e87-6c23-4aad-9f3d-53e700cc1be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f08c043-c413-40a7-9fe5-a284769f254e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Volume volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e (bb762ee9-a656-40ce-9996-ff2cfd0d209e): created successfully Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (030c9e87-6c23-4aad-9f3d-53e700cc1be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Flow 'volume_create_manager' (b0b13bbc-b160-4d82-aea7-1d344d715ca3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:06 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4f80a0db-bc3a-4e66-944f-c93792b6d5e8 tempest-GroupsTest-468509995 None] Created volume successfully. Apr 13 11:05:06 devstack sudo[88509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:05:06 devstack sudo[88509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:07 devstack sudo[88509]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.456s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5477cce7-746e-4707-8fc0-c2fb70718dc0]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:07 devstack sudo[88514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:05:07 devstack sudo[88514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:07 devstack sudo[88514]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.504s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Acquiring lock "cinder-quobyte-bb762ee9-a656-40ce-9996-ff2cfd0d209e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:07 devstack sudo[88519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img Apr 13 11:05:07 devstack sudo[88519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Lock "cinder-quobyte-bb762ee9-a656-40ce-9996-ff2cfd0d209e" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6dc0578-0744-4d92-a305-ad5c9da440ba]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:07 devstack sudo[88521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e Apr 13 11:05:07 devstack sudo[88521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:08 devstack sudo[88521]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e" returned: 0 in 0.734s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:08 devstack sudo[88536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e Apr 13 11:05:08 devstack sudo[88536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:09 devstack sudo[88519]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img" returned: 0 in 1.880s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a63eb4-5d41-4095-94d2-7f56c7ffd27d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:09 devstack sudo[88538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:05:09 devstack sudo[88538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:09 devstack sudo[88536]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb762ee9-a656-40ce-9996-ff2cfd0d209e" returned: 0 in 1.192s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Lock "cinder-quobyte-bb762ee9-a656-40ce-9996-ff2cfd0d209e" released by "delete_volume" :: held 1.951s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Created reservations ['86b29439-95b1-4461-8420-1194502fa3d6'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:09 devstack cinder-volume[82656]: WARNING cinder.quota [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-537364931 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-537364931, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:05:09 devstack cinder-volume[82656]: WARNING cinder.quota [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-537364931 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-537364931, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Created reservations ['37a95d9c-d014-4f65-b100-295da4115f28', 'a78fa529-54fa-4fd8-b85f-4dd93cd9e7f2', '5612da8d-d501-48d6-963f-a37080201dfe', '6b60684f-948b-4370-a461-2fcfb8a62b09'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:09 devstack sudo[88541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:05:09 devstack sudo[88541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Created reservations ['cc810305-2ef1-45bb-a47c-a2ceec622d9b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:09 devstack sudo[88546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:05:09 devstack sudo[88546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:10 devstack sudo[88538]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.618s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba, size 1024.00 MB, duration 1.88 sec, destination /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:05:10 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Converted 1024.00 MB image at 544.28 MB/s Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] 3ee7a50c-f59a-478c-8785-cc47cde25638 was raw, converting to qcow2 {{(pid=82656) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1176}} Apr 13 11:05:10 devstack sudo[88541]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.416s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[138f2f34-16ad-4830-af40-fe213c5786b7]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:10 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-952562e6-bd9e-4734-beae-421c1f524444 tempest-GroupsTest-468509995 None] Delete group completed successfully. Apr 13 11:05:10 devstack sudo[88549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img Apr 13 11:05:10 devstack sudo[88549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:10 devstack sudo[88546]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.407s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:05:10 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6970ca52-fd68-4fda-809e-38950fc73457 tempest-GroupsTest-468509995 None] Delete group completed successfully. Apr 13 11:05:10 devstack sudo[88549]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img" returned: 0 in 0.454s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:10 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img Apr 13 11:05:10 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:11 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img" returned: 1 in 0.494s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:05:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img /opt/stack/data/cinder/conversion/vol_upload_zr81ucya {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:11 devstack sudo[88559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img /opt/stack/data/cinder/conversion/vol_upload_zr81ucya Apr 13 11:05:11 devstack sudo[88559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:11 devstack sudo[88559]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img /opt/stack/data/cinder/conversion/vol_upload_zr81ucya" returned: 0 in 0.699s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:11 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Image conversion details: src /opt/stack/data/cinder/conversion/ce7fc918-3fed-4d9e-b97a-e46c267183ba.temp_image.3ee7a50c-f59a-478c-8785-cc47cde25638higfi7g7.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_zr81ucya {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:05:11 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Converted 1024.00 MB image at 1024.00 MB/s Apr 13 11:05:11 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6eef962-93ea-48e6-97ae-3b7211d61fa2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zr81ucya {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:11 devstack sudo[88565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zr81ucya Apr 13 11:05:11 devstack sudo[88565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c83f9d65-5bf4-4ea1-b7c9-35a7f2da664f tempest-GroupsTest-468509995 None] Group tempest-GroupsTest-Group-1543665418: creating Apr 13 11:05:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c83f9d65-5bf4-4ea1-b7c9-35a7f2da664f tempest-GroupsTest-468509995 None] Group tempest-GroupsTest-Group-1543665418: created successfully Apr 13 11:05:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-c83f9d65-5bf4-4ea1-b7c9-35a7f2da664f tempest-GroupsTest-468509995 None] Create group completed successfully. Apr 13 11:05:12 devstack sudo[88565]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_zr81ucya" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 6.383s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:12 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Uploaded volume to glance image-id: 3ee7a50c-f59a-478c-8785-cc47cde25638. {{(pid=82656) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Apr 13 11:05:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-141bbeaa-6ab7-4c84-aad6-a92eb5ff62bc tempest-VolumesActionsTest-436468360 None] Copy volume to image completed successfully. Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Flow 'volume_create_manager' (149447a9-fbf1-4130-ab77-4e39e4ad8dc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4d67b8-e057-4745-8d09-45d4cf77b38e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d4d67b8-e057-4745-8d09-45d4cf77b38e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-190628316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acc36481-8a99-481f-84db-c41984e2f538,host='devstack@QuobyteHD#QuobyteHD',id=091aca01-ecbb-43b5-bbcd-9b390819ba9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747bc244b1c453aadaccf1775f17aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:13Z,use_quota=True,user_id='e7119d20ba004fdba93e3601f64ec860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34bd6036-5b12-4896-92ee-2d53662e8453),volume_type_id=34bd6036-5b12-4896-92ee-2d53662e8453)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7aa580-694a-44f6-a45e-f453d325b435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7aa580-694a-44f6-a45e-f453d325b435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75944870-a0b7-47c3-85b3-fdb497a5e50e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75944870-a0b7-47c3-85b3-fdb497a5e50e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '091aca01-ecbb-43b5-bbcd-9b390819ba9a', 'volume_name': 'volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20295199-6838-4bc3-bcee-90227c1ce898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20295199-6838-4bc3-bcee-90227c1ce898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb1a858-3547-47dc-8283-b26b6a6e2c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:13 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Volume 091aca01-ecbb-43b5-bbcd-9b390819ba9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a', 'volume_size': 1} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acc36481-8a99-481f-84db-c41984e2f538,created_at=2026-04-13T09:05:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-190628316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acc36481-8a99-481f-84db-c41984e2f538,host='devstack@QuobyteHD#QuobyteHD',id=091aca01-ecbb-43b5-bbcd-9b390819ba9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747bc244b1c453aadaccf1775f17aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:13Z,use_quota=True,user_id='e7119d20ba004fdba93e3601f64ec860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34bd6036-5b12-4896-92ee-2d53662e8453),volume_type_id=34bd6036-5b12-4896-92ee-2d53662e8453)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Creating volume 091aca01-ecbb-43b5-bbcd-9b390819ba9a {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:13 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:13 devstack sudo[88570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a 1073741824 Apr 13 11:05:13 devstack sudo[88570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:13 devstack sudo[88570]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a 1073741824" returned: 0 in 0.486s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Acquiring lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:13 devstack sudo[88575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a Apr 13 11:05:13 devstack sudo[88575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Acquiring lock "cinder-quobyte-ce7fc918-3fed-4d9e-b97a-e46c267183ba" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Lock "cinder-quobyte-ce7fc918-3fed-4d9e-b97a-e46c267183ba" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8af7705-497f-4f09-8b04-f019e1c3023a]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:14 devstack sudo[88577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:05:14 devstack sudo[88577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:14 devstack sudo[88575]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a" returned: 0 in 0.429s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbb1a858-3547-47dc-8283-b26b6a6e2c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b3b96e-4c6f-47b7-8a0f-fb4651f43a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:14 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Volume volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a (091aca01-ecbb-43b5-bbcd-9b390819ba9a): created successfully Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2b3b96e-4c6f-47b7-8a0f-fb4651f43a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Flow 'volume_create_manager' (149447a9-fbf1-4130-ab77-4e39e4ad8dc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:14 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2007a8a0-5397-4850-a1b3-046260c0f10f tempest-GroupsTest-468509995 None] Created volume successfully. Apr 13 11:05:14 devstack sudo[88577]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.492s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:14 devstack sudo[88583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba Apr 13 11:05:14 devstack sudo[88583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:14 devstack sudo[88583]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ce7fc918-3fed-4d9e-b97a-e46c267183ba" returned: 0 in 0.413s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Lock "cinder-quobyte-ce7fc918-3fed-4d9e-b97a-e46c267183ba" released by "delete_volume" :: held 0.926s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Created reservations ['2a7c80c7-9ca4-4a27-8043-0f7d12389d58', 'ba5e0650-7521-4f7f-a1e5-8d7fc5d87847', 'b9cd6efd-bac8-437e-a0f8-3132e7227b57', '4d47a6f9-9d88-4e02-b521-93ecb73b8f2b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:15 devstack sudo[88586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:05:15 devstack sudo[88586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:15 devstack sudo[88586]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.422s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:05:15 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Deleted volume successfully. Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-66c6488a-4db6-4a45-a956-6200b3a5083e tempest-VolumesActionsTest-436468360 None] Lock "cinder-ce7fc918-3fed-4d9e-b97a-e46c267183ba-delete_volume" released by "delete_volume" :: held 1.463s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Flow 'volume_create_manager' (e19f6c9c-c93d-446e-b533-dddbec8bfa00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309ee12e-4f35-487a-95ad-20b73ee7a0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (309ee12e-4f35-487a-95ad-20b73ee7a0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-766519039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acc36481-8a99-481f-84db-c41984e2f538,host='devstack@QuobyteHD#QuobyteHD',id=0bb9c29a-8e5c-40ca-837a-2ecfed0866e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747bc244b1c453aadaccf1775f17aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:16Z,use_quota=True,user_id='e7119d20ba004fdba93e3601f64ec860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34bd6036-5b12-4896-92ee-2d53662e8453),volume_type_id=34bd6036-5b12-4896-92ee-2d53662e8453)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f57e343-d8ab-4523-988a-102714a8ce7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f57e343-d8ab-4523-988a-102714a8ce7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fdff3e-73d5-4437-86d9-72684e24a955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00fdff3e-73d5-4437-86d9-72684e24a955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bb9c29a-8e5c-40ca-837a-2ecfed0866e8', 'volume_name': 'volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290a66b3-d378-46d2-b3fc-201e91812156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (290a66b3-d378-46d2-b3fc-201e91812156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0470506-83c9-43c3-9724-8a84e684b628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:15 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Volume 0bb9c29a-8e5c-40ca-837a-2ecfed0866e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8', 'volume_size': 1} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=acc36481-8a99-481f-84db-c41984e2f538,created_at=2026-04-13T09:05:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-766519039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=acc36481-8a99-481f-84db-c41984e2f538,host='devstack@QuobyteHD#QuobyteHD',id=0bb9c29a-8e5c-40ca-837a-2ecfed0866e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747bc244b1c453aadaccf1775f17aa2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:16Z,use_quota=True,user_id='e7119d20ba004fdba93e3601f64ec860',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34bd6036-5b12-4896-92ee-2d53662e8453),volume_type_id=34bd6036-5b12-4896-92ee-2d53662e8453)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Creating volume 0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:15 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:05:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:15 devstack sudo[88589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 1073741824 Apr 13 11:05:15 devstack sudo[88589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:16 devstack sudo[88589]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 1073741824" returned: 0 in 0.542s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:16 devstack sudo[88595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 Apr 13 11:05:16 devstack sudo[88595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:16 devstack sudo[88595]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8" returned: 0 in 0.488s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0470506-83c9-43c3-9724-8a84e684b628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcccb9a-6b26-4651-a208-3b2a78f34cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:16 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Volume volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 (0bb9c29a-8e5c-40ca-837a-2ecfed0866e8): created successfully Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efcccb9a-6b26-4651-a208-3b2a78f34cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Flow 'volume_create_manager' (e19f6c9c-c93d-446e-b533-dddbec8bfa00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6bb7c55b-ae2b-4f8f-908f-a5a4c4567cd2 tempest-GroupsTest-468509995 None] Created volume successfully. Apr 13 11:05:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f516c7ed-fb1d-4133-8258-cb3b8e537532 tempest-GroupsTest-468509995 None] Update group completed successfully. Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Flow 'volume_create_manager' (5088c076-38cf-4e41-939f-50e2a72954e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd78aa2-f7ef-4415-b8da-7ff5612b5b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcd78aa2-f7ef-4415-b8da-7ff5612b5b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1974683946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b92f3-9458-437a-b68e-e1752bc15e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8f6709d9d42ab8fd02a29246afc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:19Z,use_quota=True,user_id='746971f3dc8d41059e0e45ff3a863a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea148b-a007-4bbc-81fe-56b4278d7403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0ea148b-a007-4bbc-81fe-56b4278d7403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1baba1-388e-4f7f-91eb-611e27a9fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef1baba1-388e-4f7f-91eb-611e27a9fe32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0b92f3-9458-437a-b68e-e1752bc15e7c', 'volume_name': 'volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cc4f13-8b85-4d1f-bb55-836e8d32eee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84cc4f13-8b85-4d1f-bb55-836e8d32eee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43158dba-fdf5-4211-bafa-3c0e8c76e42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:18 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Volume 3e0b92f3-9458-437a-b68e-e1752bc15e7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c', 'volume_size': 1} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1974683946',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0b92f3-9458-437a-b68e-e1752bc15e7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8f6709d9d42ab8fd02a29246afc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:19Z,use_quota=True,user_id='746971f3dc8d41059e0e45ff3a863a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Creating volume 3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:18 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:05:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:18 devstack sudo[88601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c 1073741824 Apr 13 11:05:18 devstack sudo[88601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:19 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-a7495932-a816-41eb-bdeb-d4b9f085504b tempest-GroupsTest-468509995 None] Update group completed successfully. Apr 13 11:05:19 devstack sudo[88601]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c 1073741824" returned: 0 in 0.509s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:19 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c Apr 13 11:05:19 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:19 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c" returned: 0 in 0.392s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.925s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43158dba-fdf5-4211-bafa-3c0e8c76e42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20da0f67-3dd4-42a9-94e0-dab324c4fde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:19 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Volume volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c (3e0b92f3-9458-437a-b68e-e1752bc15e7c): created successfully Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20da0f67-3dd4-42a9-94e0-dab324c4fde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Flow 'volume_create_manager' (5088c076-38cf-4e41-939f-50e2a72954e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:19 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6a4c75f4-ff57-42a0-a815-5901e0bfeb0a tempest-VolumesCloneTest-148720716 None] Created volume successfully. Apr 13 11:05:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Acquiring lock "cinder-quobyte-091aca01-ecbb-43b5-bbcd-9b390819ba9a" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Lock "cinder-quobyte-091aca01-ecbb-43b5-bbcd-9b390819ba9a" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:20 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7303d381-8079-485e-be4a-d5be18dfcbc6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:20 devstack sudo[88609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a Apr 13 11:05:20 devstack sudo[88609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Flow 'volume_create_manager' (48522119-55a1-401b-9e9d-6acaf14424fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a19776-9624-4a36-9cc3-9853a73f7d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9a19776-9624-4a36-9cc3-9853a73f7d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2062357242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d91a4ab6-0658-43ef-9fa0-af4fbe1865e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fb8f6709d9d42ab8fd02a29246afc73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=3e0b92f3-9458-437a-b68e-e1752bc15e7c,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:21Z,use_quota=True,user_id='746971f3dc8d41059e0e45ff3a863a30',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13959cb6-d967-40b5-aac6-b0c532fb00a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13959cb6-d967-40b5-aac6-b0c532fb00a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03532846-0adc-432f-916e-b0e02c985e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03532846-0adc-432f-916e-b0e02c985e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd91a4ab6-0658-43ef-9fa0-af4fbe1865e6', 'volume_name': 'volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6', 'volume_size': 2, 'source_volid': '3e0b92f3-9458-437a-b68e-e1752bc15e7c', 'source_volstatus': 'available'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f16f435-f71c-4e13-bf91-39bb3927db80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f16f435-f71c-4e13-bf91-39bb3927db80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf977c8-4f68-41f4-9cd9-358c698f45ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:21 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Volume d91a4ab6-0658-43ef-9fa0-af4fbe1865e6: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6', 'volume_size': 2, 'source_volid': '3e0b92f3-9458-437a-b68e-e1752bc15e7c', 'source_volstatus': 'available'} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:21 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Cloning volume 3e0b92f3-9458-437a-b68e-e1752bc15e7c to volume d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 Apr 13 11:05:21 devstack sudo[88609]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a" returned: 0 in 0.522s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:21 devstack sudo[88620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a Apr 13 11:05:21 devstack sudo[88620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Creating offline snapshot a2075af9-9005-4e30-a9ae-138d29504876 of volume 3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef2f347-466a-486c-b994-9514548ab1d1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:21 devstack sudo[88622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c Apr 13 11:05:21 devstack sudo[88622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:21 devstack sudo[88620]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-091aca01-ecbb-43b5-bbcd-9b390819ba9a" returned: 0 in 0.412s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Lock "cinder-quobyte-091aca01-ecbb-43b5-bbcd-9b390819ba9a" released by "delete_volume" :: held 0.956s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Acquiring lock "cinder-quobyte-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Lock "cinder-quobyte-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f3c4b7-154e-4cc7-b1be-c4f64129ad0e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:21 devstack sudo[88628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 Apr 13 11:05:21 devstack sudo[88628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:21 devstack sudo[88622]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:21 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 1G Apr 13 11:05:21 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:22 devstack sudo[88628]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8" returned: 0 in 0.505s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:22 devstack sudo[88639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8 Apr 13 11:05:22 devstack sudo[88639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:22 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 1G" returned: 0 in 0.500s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:22 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 Apr 13 11:05:22 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:22 devstack sudo[88639]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8" returned: 0 in 0.414s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Lock "cinder-quobyte-0bb9c29a-8e5c-40ca-837a-2ecfed0866e8" released by "delete_volume" :: held 0.940s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Created reservations ['5a237c66-13ef-4079-9f23-c42732383341'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:22 devstack cinder-volume[82656]: WARNING cinder.quota [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2100539888 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2100539888, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:05:22 devstack cinder-volume[82656]: WARNING cinder.quota [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2100539888 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2100539888, it is now deprecated. Please use the default quota class for default quota. Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Created reservations ['2edb59bb-783d-4b2f-9a34-c04faff52cf1', 'e02becd1-7894-46d0-aece-af26dc06fa3e', '912b2f95-35c7-4b08-864d-81ba66a95a6f', 'ebada870-2b88-46df-90f9-f5046b60e35f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:22 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876" returned: 0 in 0.439s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:22 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 is being set with open permissions: ugo+rw Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:22 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 Apr 13 11:05:22 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Created reservations ['7ee2065b-2ecd-456c-9f42-b81e4c872fdd', 'c18e9b8f-79ce-498b-98db-751737b1fc01', 'a1df2c01-ddfc-454f-a399-6ac2eeec0025', 'f329f81a-900f-4a46-a5bb-2968a1cabf37'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:22 devstack sudo[88649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:05:22 devstack sudo[88649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:23 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876" returned: 0 in 0.463s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:23 devstack sudo[88652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.info Apr 13 11:05:23 devstack sudo[88652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:23 devstack sudo[88649]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.501s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:23 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:05:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9dd8458e-e6ed-4d74-9aca-624dc6d392f2 tempest-GroupsTest-468509995 None] Delete group completed successfully. Apr 13 11:05:23 devstack sudo[88652]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.info" returned: 0 in 0.501s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:23 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.info is being set with open permissions: ugo+rw Apr 13 11:05:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:23 devstack sudo[88656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.info Apr 13 11:05:23 devstack sudo[88656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:24 devstack sudo[88656]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.info" returned: 0 in 0.531s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Acquiring lock "cinder-quobyte-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Lock "cinder-quobyte-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] snapshot: a2075af9-9005-4e30-a9ae-138d29504876, volume: d91a4ab6-0658-43ef-9fa0-af4fbe1865e6, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d66e527-5aad-4cd6-a47e-00583d2a798d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:24 devstack sudo[88659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 Apr 13 11:05:24 devstack sudo[88659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:24 devstack sudo[88659]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876" returned: 0 in 0.532s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c849545b-58f4-4093-977e-bbad3671ad3f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:24 devstack sudo[88664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c Apr 13 11:05:24 devstack sudo[88664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:25 devstack sudo[88664]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c" returned: 0 in 0.521s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:25 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:05:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:25 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 Apr 13 11:05:25 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:27 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" returned: 0 in 2.211s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:27 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0cdcc55-0197-4a88-a7e1-3f04ab5943bd]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:27 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c Apr 13 11:05:27 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:28 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c" returned: 0 in 0.711s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c, size 1024.00 MB, duration 2.21 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:05:28 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Converted 1024.00 MB image at 462.95 MB/s Apr 13 11:05:28 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 is being set with open permissions: ugo+rw Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:28 devstack sudo[88686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 Apr 13 11:05:28 devstack sudo[88686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:28 devstack sudo[88686]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" returned: 0 in 0.410s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Lock "cinder-quobyte-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" released by "_copy_volume_from_snapshot" :: held 4.435s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Acquiring lock "cinder-quobyte-a2075af9-9005-4e30-a9ae-138d29504876" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Lock "cinder-quobyte-a2075af9-9005-4e30-a9ae-138d29504876" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Deleting offline snapshot a2075af9-9005-4e30-a9ae-138d29504876 of volume 3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] snapshot_file for this snap is: volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c526f7-49bc-4b17-9ffd-9b23676e8d9d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:28 devstack sudo[88689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 Apr 13 11:05:28 devstack sudo[88689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:29 devstack sudo[88689]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876" returned: 0 in 0.550s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:05:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c535812-87ce-4794-aad9-b0f04dc68b85]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:29 devstack sudo[88694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c Apr 13 11:05:29 devstack sudo[88694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:29 devstack sudo[88694]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c" returned: 0 in 0.528s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:29 devstack sudo[88699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 Apr 13 11:05:29 devstack sudo[88699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:30 devstack sudo[88699]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876" returned: 0 in 0.551s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:30 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876 Apr 13 11:05:30 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:30 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c.a2075af9-9005-4e30-a9ae-138d29504876" returned: 0 in 0.438s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Lock "cinder-quobyte-a2075af9-9005-4e30-a9ae-138d29504876" released by "_delete_snapshot" :: held 2.115s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.616s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf977c8-4f68-41f4-9cd9-358c698f45ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6', 'volume_size': 2, 'source_volid': '3e0b92f3-9458-437a-b68e-e1752bc15e7c', 'source_volstatus': 'available'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb85aec-f6ad-42c8-baea-7cee06aec35e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:30 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Volume volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 (d91a4ab6-0658-43ef-9fa0-af4fbe1865e6): created successfully Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7eb85aec-f6ad-42c8-baea-7cee06aec35e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Flow 'volume_create_manager' (48522119-55a1-401b-9e9d-6acaf14424fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:30 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-41319916-f40b-4844-a27c-879d9876af68 tempest-VolumesCloneTest-148720716 None] Created volume successfully. Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Flow 'volume_create_manager' (8a1de1f4-dacb-402b-a3d3-03e4e44ac74e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858fb7bb-25f6-4a43-8a39-9dff0879b10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858fb7bb-25f6-4a43-8a39-9dff0879b10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1405122959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd4304e-95e7-4ab8-8c18-860dc1c5745c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd7a7b737644ce08d8944b990bcf4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:31Z,use_quota=True,user_id='ec893a3970db43d2955d5b05dabf05de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd489793-aa8d-40b8-86e5-eae5090719ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd489793-aa8d-40b8-86e5-eae5090719ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d979a15-0c1b-441b-9474-b982fddf2fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d979a15-0c1b-441b-9474-b982fddf2fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cd4304e-95e7-4ab8-8c18-860dc1c5745c', 'volume_name': 'volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75973a47-3daf-43cd-8415-626d9d1bd5af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75973a47-3daf-43cd-8415-626d9d1bd5af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4cf1e3-3347-44e9-bd60-2ab0cf8e4d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Volume 0cd4304e-95e7-4ab8-8c18-860dc1c5745c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c', 'volume_size': 1} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1405122959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cd4304e-95e7-4ab8-8c18-860dc1c5745c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5dd7a7b737644ce08d8944b990bcf4da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:31Z,use_quota=True,user_id='ec893a3970db43d2955d5b05dabf05de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Creating volume 0cd4304e-95e7-4ab8-8c18-860dc1c5745c {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:31 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:31 devstack sudo[88707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c 1073741824 Apr 13 11:05:31 devstack sudo[88707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Acquiring lock "cinder-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Lock "cinder-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:31 devstack sudo[88707]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Acquiring lock "cinder-quobyte-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c 1073741824" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Lock "cinder-quobyte-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0be3f0c-69d4-48d8-8d20-a67388011650]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:31 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c Apr 13 11:05:31 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:31 devstack sudo[88713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 Apr 13 11:05:31 devstack sudo[88713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:32 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" returned: 0 in 0.440s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb4cf1e3-3347-44e9-bd60-2ab0cf8e4d59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac1d4e8-a667-4ae0-9c45-621c83068e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:32 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Volume volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c (0cd4304e-95e7-4ab8-8c18-860dc1c5745c): created successfully Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dac1d4e8-a667-4ae0-9c45-621c83068e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Flow 'volume_create_manager' (8a1de1f4-dacb-402b-a3d3-03e4e44ac74e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:32 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-71c9c11f-43a4-4aaa-a5b0-0186522d2bfd tempest-SnapshotMetadataTestJSON-1653529593 None] Created volume successfully. Apr 13 11:05:32 devstack sudo[88713]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" returned: 0 in 0.516s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:32 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6 Apr 13 11:05:32 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:32 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" returned: 0 in 0.419s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Lock "cinder-quobyte-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6" released by "delete_volume" :: held 0.957s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Created reservations ['a98f937c-9f7b-495b-ae71-14f80be58765', '792c2d9b-00bf-4a6d-a8e0-0fb965baff95', '4dc2738b-9489-4bc5-97dc-976d1c29ae57', '3eb36473-4096-462a-9ec7-53345315b209'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:32 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:05:32 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Acquiring lock "cinder-3e0b92f3-9458-437a-b68e-e1752bc15e7c-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Lock "cinder-3e0b92f3-9458-437a-b68e-e1752bc15e7c-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Acquiring lock "cinder-quobyte-3e0b92f3-9458-437a-b68e-e1752bc15e7c" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Lock "cinder-quobyte-3e0b92f3-9458-437a-b68e-e1752bc15e7c" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2859ad1-d244-48f8-a19e-58ce8b5b4306]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:33 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c Apr 13 11:05:33 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:33 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.543s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:05:33 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Deleted volume successfully. Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-94006b0f-38b8-42d2-a5c0-2e1d0238c7c2 tempest-VolumesCloneTest-148720716 None] Lock "cinder-d91a4ab6-0658-43ef-9fa0-af4fbe1865e6-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Creating offline snapshot 7fad9d1f-b691-4d3c-b1db-252fef00c936 of volume 0cd4304e-95e7-4ab8-8c18-860dc1c5745c {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c99e9952-7097-4fab-b564-36adc8118e0c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:33 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c Apr 13 11:05:33 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:33 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c" returned: 0 in 0.555s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:33 devstack sudo[88734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c Apr 13 11:05:33 devstack sudo[88734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:33 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" returned: 0 in 0.483s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:34 devstack sudo[88734]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-3e0b92f3-9458-437a-b68e-e1752bc15e7c" returned: 0 in 0.420s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:34 devstack sudo[88740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 1G Apr 13 11:05:34 devstack sudo[88740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Lock "cinder-quobyte-3e0b92f3-9458-437a-b68e-e1752bc15e7c" released by "delete_volume" :: held 1.002s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Created reservations ['1acdf8f1-8369-4657-8f4c-2ead3aeb9cab', '527b9145-15b7-4fbf-b001-3db67ea73629', 'e96dd9ba-0a78-4f33-a96a-20d29533ecf3', 'd4ca01b9-bdc0-42f1-bbca-e8c43dbc5ee5'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:34 devstack sudo[88742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:05:34 devstack sudo[88742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:34 devstack sudo[88740]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 1G" returned: 0 in 0.516s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:34 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 Apr 13 11:05:34 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:34 devstack sudo[88742]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.439s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:05:34 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Deleted volume successfully. Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-6a01d3bf-92c4-43f8-b733-7c3ae0bd61f2 tempest-VolumesCloneTest-148720716 None] Lock "cinder-3e0b92f3-9458-437a-b68e-e1752bc15e7c-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:34 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936" returned: 0 in 0.429s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:34 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 is being set with open permissions: ugo+rw Apr 13 11:05:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:34 devstack sudo[88753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 Apr 13 11:05:34 devstack sudo[88753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:35 devstack sudo[88753]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936" returned: 0 in 0.429s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:35 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.info Apr 13 11:05:35 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:35 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.info" returned: 0 in 0.488s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:35 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.info is being set with open permissions: ugo+rw Apr 13 11:05:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:35 devstack sudo[88759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.info Apr 13 11:05:35 devstack sudo[88759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:36 devstack sudo[88759]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.info" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.891s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2a99f7e5-ab5c-41b9-981f-df851780f34d tempest-SnapshotMetadataTestJSON-1653529593 None] Create snapshot completed successfully Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "cinder-7fad9d1f-b691-4d3c-b1db-252fef00c936-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-7fad9d1f-b691-4d3c-b1db-252fef00c936-delete_snapshot" acquired by "delete_snapshot" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "cinder-quobyte-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-quobyte-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "cinder-quobyte-7fad9d1f-b691-4d3c-b1db-252fef00c936" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-quobyte-7fad9d1f-b691-4d3c-b1db-252fef00c936" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Deleting offline snapshot 7fad9d1f-b691-4d3c-b1db-252fef00c936 of volume 0cd4304e-95e7-4ab8-8c18-860dc1c5745c {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] snapshot_file for this snap is: volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c4f51ce-6e19-42d6-a4c7-5b79a2091730]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:37 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 Apr 13 11:05:37 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:37 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936" returned: 0 in 0.519s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6524fd-61ee-46a6-8b22-420a16489b38]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:37 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c Apr 13 11:05:37 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:38 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" returned: 0 in 0.566s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:38 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 Apr 13 11:05:38 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:38 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:05:38 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:38 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936" returned: 0 in 0.596s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:38 devstack sudo[88811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936 Apr 13 11:05:38 devstack sudo[88811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:39 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.511s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:05:39 devstack sudo[88811]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c.7fad9d1f-b691-4d3c-b1db-252fef00c936" returned: 0 in 0.482s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-quobyte-7fad9d1f-b691-4d3c-b1db-252fef00c936" released by "_delete_snapshot" :: held 2.226s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-quobyte-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" released by "delete_snapshot" :: held 2.239s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:39 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Created reservations ['83486bc3-0a2b-48eb-a2b4-c4e922135865', '16fd7750-3edb-436c-8d86-7a1b3adad871', 'ebad6415-1e26-4f73-9bac-1f58553334e5', '56670092-7adb-480c-8158-024bf7719186'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Delete snapshot completed successfully. Apr 13 11:05:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eaa3474-a5d6-43a8-87df-12cd1f325ea6 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-7fad9d1f-b691-4d3c-b1db-252fef00c936-delete_snapshot" released by "delete_snapshot" :: held 2.320s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "cinder-0cd4304e-95e7-4ab8-8c18-860dc1c5745c-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-0cd4304e-95e7-4ab8-8c18-860dc1c5745c-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "cinder-quobyte-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-quobyte-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:40 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b99d05-3eb2-420c-89af-f7101bd8966c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:40 devstack sudo[88817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c Apr 13 11:05:40 devstack sudo[88817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:41 devstack sudo[88817]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" returned: 0 in 0.595s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:41 devstack sudo[88822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c Apr 13 11:05:41 devstack sudo[88822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:41 devstack sudo[88822]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" returned: 0 in 0.498s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-quobyte-0cd4304e-95e7-4ab8-8c18-860dc1c5745c" released by "delete_volume" :: held 1.157s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Created reservations ['66aa1421-5e69-47b9-bd54-782cc7f07477', '765ee55e-3d6a-4464-b6de-8c9f2ab33ac7', 'c849b2f8-1203-4243-83d9-159191cabffb', 'b916cb00-127b-4370-9a6a-4394dc470d57'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:41 devstack sudo[88825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:05:41 devstack sudo[88825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:42 devstack sudo[88825]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.526s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:05:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Deleted volume successfully. Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5eb920ef-c2b1-4281-9f87-2756047f8711 tempest-SnapshotMetadataTestJSON-1653529593 None] Lock "cinder-0cd4304e-95e7-4ab8-8c18-860dc1c5745c-delete_volume" released by "delete_volume" :: held 1.815s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (c1810678-5ae3-4b18-a4ad-081450e68c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fd25da-2058-47b5-909e-c3cab9d8993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fd25da-2058-47b5-909e-c3cab9d8993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-578803876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6664bc4647b14fe9b1001830b6624cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:43Z,use_quota=True,user_id='eca98081421a4f4e998562916183ae8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f305b6-be3c-45c7-adc5-0deeeccf243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f305b6-be3c-45c7-adc5-0deeeccf243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f1e4d2-0fe1-4dd9-ae36-f79913e62958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43f1e4d2-0fe1-4dd9-ae36-f79913e62958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f', 'volume_name': 'volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4380b5-b444-4b66-8e73-b8a59d84d74c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f4380b5-b444-4b66-8e73-b8a59d84d74c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914078db-a810-4f00-9210-53ef9391b441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:42 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Volume ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f', 'volume_size': 1} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-578803876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6664bc4647b14fe9b1001830b6624cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:43Z,use_quota=True,user_id='eca98081421a4f4e998562916183ae8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Creating volume ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:42 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:05:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:42 devstack sudo[88831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f 1073741824 Apr 13 11:05:42 devstack sudo[88831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:43 devstack sudo[88831]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f 1073741824" returned: 0 in 0.551s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:43 devstack sudo[88836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f Apr 13 11:05:43 devstack sudo[88836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:43 devstack sudo[88836]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.048s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (914078db-a810-4f00-9210-53ef9391b441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdff136-4185-420d-9720-e3ebca9189ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:43 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Volume volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f (ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f): created successfully Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1cdff136-4185-420d-9720-e3ebca9189ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (c1810678-5ae3-4b18-a4ad-081450e68c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0503a493-9e11-457b-8bd9-ab4eb6b4addc tempest-VolumesSnapshotTestJSON-75564979 None] Created volume successfully. Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Creating offline snapshot 593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 of volume ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e5f3f3-905e-4e02-9730-6e6ec7e04519]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:45 devstack sudo[88839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f Apr 13 11:05:45 devstack sudo[88839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:45 devstack sudo[88839]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" returned: 0 in 0.526s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:45 devstack sudo[88844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 1G Apr 13 11:05:45 devstack sudo[88844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Flow 'volume_create_manager' (6744eb15-906f-459f-b821-0b6b84a4559d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec6e36f-bb17-42ab-b61d-42d3384d60af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ec6e36f-bb17-42ab-b61d-42d3384d60af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1795462960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cea483-42fe-4c5a-8703-a72086f2a909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdbc3725f624a79b5cbc3e2d86831e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:46Z,use_quota=True,user_id='6781ac82e3a84f6b86e146695ccfafee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e2f3b9-e436-4321-950e-5ac9143f6f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15e2f3b9-e436-4321-950e-5ac9143f6f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cde8ec-0a3f-4b86-9fc6-a91b22485fff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cde8ec-0a3f-4b86-9fc6-a91b22485fff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17cea483-42fe-4c5a-8703-a72086f2a909', 'volume_name': 'volume-17cea483-42fe-4c5a-8703-a72086f2a909', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd920c70-bc4e-4dce-831c-23bc00e55b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd920c70-bc4e-4dce-831c-23bc00e55b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43c195e-d3e1-4821-9594-05e6d3bbb127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:45 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Volume 17cea483-42fe-4c5a-8703-a72086f2a909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17cea483-42fe-4c5a-8703-a72086f2a909', 'volume_size': 1} Apr 13 11:05:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:46 devstack sudo[88844]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 1G" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:46 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 Apr 13 11:05:46 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:46 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8" returned: 0 in 0.425s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:46 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 is being set with open permissions: ugo+rw Apr 13 11:05:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:46 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 Apr 13 11:05:46 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:46 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8" returned: 0 in 0.433s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:46 devstack sudo[88857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.info Apr 13 11:05:46 devstack sudo[88857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:47 devstack sudo[88857]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.info" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:47 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.info is being set with open permissions: ugo+rw Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:47 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.info Apr 13 11:05:47 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:47 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.info" returned: 0 in 0.425s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.793s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.063s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1795462960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17cea483-42fe-4c5a-8703-a72086f2a909,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdbc3725f624a79b5cbc3e2d86831e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:46Z,use_quota=True,user_id='6781ac82e3a84f6b86e146695ccfafee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Creating volume 17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:47 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:05:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:47 devstack sudo[88863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 1073741824 Apr 13 11:05:47 devstack sudo[88863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:47 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0e1d3c24-b292-4e79-ae45-0059a37f6190 tempest-VolumesSnapshotTestJSON-75564979 None] Create snapshot completed successfully Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-593ecf98-5195-4cf8-a803-f6ab5fc3cdd8-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-593ecf98-5195-4cf8-a803-f6ab5fc3cdd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-593ecf98-5195-4cf8-a803-f6ab5fc3cdd8" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-593ecf98-5195-4cf8-a803-f6ab5fc3cdd8" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Deleting offline snapshot 593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 of volume ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] snapshot_file for this snap is: volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3b11ebf-7d5e-4116-b992-afee80aeceaf]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:48 devstack sudo[88863]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 1073741824" returned: 0 in 0.544s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:48 devstack sudo[88868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 Apr 13 11:05:48 devstack sudo[88868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:48 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 Apr 13 11:05:48 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:48 devstack sudo[88868]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8" returned: 0 in 0.469s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e636e9-2b61-4cba-9723-0dab63938f5f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:48 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909" returned: 0 in 0.444s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f43c195e-d3e1-4821-9594-05e6d3bbb127) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17cea483-42fe-4c5a-8703-a72086f2a909', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f7a8dc-7d4d-4226-98dc-6f3dcb886bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Volume volume-17cea483-42fe-4c5a-8703-a72086f2a909 (17cea483-42fe-4c5a-8703-a72086f2a909): created successfully Apr 13 11:05:48 devstack sudo[88876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f Apr 13 11:05:48 devstack sudo[88876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7f7a8dc-7d4d-4226-98dc-6f3dcb886bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Flow 'volume_create_manager' (6744eb15-906f-459f-b821-0b6b84a4559d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:48 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-629ca0c7-1727-4dbd-9458-f98b6ab2c8cf tempest-VolumesDeleteCascade-1527022336 None] Created volume successfully. Apr 13 11:05:49 devstack sudo[88876]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:49 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 Apr 13 11:05:49 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:49 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:49 devstack sudo[88886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8 Apr 13 11:05:49 devstack sudo[88886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Creating offline snapshot 2ecf0885-37e9-4c72-adae-0f3aec494551 of volume 17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e78854-c7c9-43e3-847e-1e32c1c232e2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:50 devstack sudo[88886]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:50 devstack sudo[88889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f.593ecf98-5195-4cf8-a803-f6ab5fc3cdd8" returned: 0 in 0.425s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:50 devstack sudo[88889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-593ecf98-5195-4cf8-a803-f6ab5fc3cdd8" released by "_delete_snapshot" :: held 1.884s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" released by "delete_snapshot" :: held 1.899s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Created reservations ['6886cc2a-f5da-4e13-8d3c-209c1fb1b6d8', 'ab34a4d4-abba-47e7-ac31-b83a5a0e2051', '840ba9e1-e20e-49dc-9311-0ff4e0389205', '5c52ab51-3afa-4cf7-8506-9647a275abb6'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:05:50 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Delete snapshot completed successfully. Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-aa2d7231-cbcf-4183-8c88-72ec6bfea091 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-593ecf98-5195-4cf8-a803-f6ab5fc3cdd8-delete_snapshot" released by "delete_snapshot" :: held 2.010s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:05:50 devstack sudo[88889]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909" returned: 0 in 0.513s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:50 devstack sudo[88894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 1G Apr 13 11:05:50 devstack sudo[88894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (a45c5eb2-3b09-4753-8a6b-e0dc6f6c01f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ba844d-643b-4c11-83b5-af813ba0b58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7ba844d-643b-4c11-83b5-af813ba0b58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-129565136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1cbe8-2794-474f-abab-598658add5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6664bc4647b14fe9b1001830b6624cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:51Z,use_quota=True,user_id='eca98081421a4f4e998562916183ae8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4e8097-b047-4ad5-bbea-e97f5b4d8b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4e8097-b047-4ad5-bbea-e97f5b4d8b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb4efcd-2805-4bbd-8a5d-f21a193b3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fb4efcd-2805-4bbd-8a5d-f21a193b3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bae1cbe8-2794-474f-abab-598658add5f6', 'volume_name': 'volume-bae1cbe8-2794-474f-abab-598658add5f6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb6df48-7e66-49e4-939a-fd6f65108dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb6df48-7e66-49e4-939a-fd6f65108dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817eb9da-e69c-4bdf-90ef-e912c7561784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:50 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Volume bae1cbe8-2794-474f-abab-598658add5f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bae1cbe8-2794-474f-abab-598658add5f6', 'volume_size': 1} Apr 13 11:05:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:51 devstack sudo[88894]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 1G" returned: 0 in 0.493s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:51 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 Apr 13 11:05:51 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:51 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551" returned: 0 in 0.442s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:51 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 is being set with open permissions: ugo+rw Apr 13 11:05:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:51 devstack sudo[88904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 Apr 13 11:05:51 devstack sudo[88904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:51 devstack sudo[88904]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551" returned: 0 in 0.411s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:52 devstack sudo[88908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.info Apr 13 11:05:52 devstack sudo[88908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:52 devstack sudo[88908]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.info" returned: 0 in 0.413s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:52 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.info is being set with open permissions: ugo+rw Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:52 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.info Apr 13 11:05:52 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:52 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.info" returned: 0 in 0.415s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.749s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.096s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-129565136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bae1cbe8-2794-474f-abab-598658add5f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6664bc4647b14fe9b1001830b6624cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:51Z,use_quota=True,user_id='eca98081421a4f4e998562916183ae8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Creating volume bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:52 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:05:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:52 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b736d712-fcf4-430a-8c53-369b5ff47597 tempest-VolumesDeleteCascade-1527022336 None] Create snapshot completed successfully Apr 13 11:05:52 devstack sudo[88914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 1073741824 Apr 13 11:05:52 devstack sudo[88914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:53 devstack sudo[88914]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 1073741824" returned: 0 in 0.510s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:53 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 Apr 13 11:05:53 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:53 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6" returned: 0 in 0.431s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.526s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Creating offline snapshot be636d6d-9ac3-471c-ac7b-c4124468b89d of volume 17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817eb9da-e69c-4bdf-90ef-e912c7561784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bae1cbe8-2794-474f-abab-598658add5f6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee09ac4-1309-4946-836f-b4c9030d02ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c319ecd-44cc-4780-b98c-f33cdef4021f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:53 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Volume volume-bae1cbe8-2794-474f-abab-598658add5f6 (bae1cbe8-2794-474f-abab-598658add5f6): created successfully Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee09ac4-1309-4946-836f-b4c9030d02ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (a45c5eb2-3b09-4753-8a6b-e0dc6f6c01f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-cbb587f9-0949-4df5-884b-e59f1927e67c tempest-VolumesSnapshotTestJSON-75564979 None] Created volume successfully. Apr 13 11:05:53 devstack sudo[88922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 Apr 13 11:05:53 devstack sudo[88922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:54 devstack sudo[88922]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551" returned: 0 in 0.485s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17cea483-42fe-4c5a-8703-a72086f2a909(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:05:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:54 devstack sudo[88927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d 1G Apr 13 11:05:54 devstack sudo[88927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:54 devstack sudo[88927]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d 1G" returned: 0 in 0.480s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:54 devstack sudo[88932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d Apr 13 11:05:54 devstack sudo[88932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:55 devstack sudo[88932]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d" returned: 0 in 0.447s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:55 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d is being set with open permissions: ugo+rw Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:55 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d Apr 13 11:05:55 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:55 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d" returned: 0 in 0.413s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.898s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.703s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Creating offline snapshot ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 of volume bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d69ea17-62dd-4524-860a-b583158956d6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:55 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0b8542b7-2ead-4f47-baa7-df73bbed07ff tempest-VolumesDeleteCascade-1527022336 None] Create snapshot completed successfully Apr 13 11:05:55 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 Apr 13 11:05:55 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:56 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6" returned: 0 in 0.463s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:56 devstack sudo[88945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 1G Apr 13 11:05:56 devstack sudo[88945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-17cea483-42fe-4c5a-8703-a72086f2a909-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-17cea483-42fe-4c5a-8703-a72086f2a909-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Performing cascade delete. {{(pid=82656) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-2ecf0885-37e9-4c72-adae-0f3aec494551-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-2ecf0885-37e9-4c72-adae-0f3aec494551-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-2ecf0885-37e9-4c72-adae-0f3aec494551" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-2ecf0885-37e9-4c72-adae-0f3aec494551" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Deleting offline snapshot 2ecf0885-37e9-4c72-adae-0f3aec494551 of volume 17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] snapshot_file for this snap is: volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25c3367-fb92-4fbf-9abc-c9c77a937a53]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:56 devstack sudo[88947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 Apr 13 11:05:56 devstack sudo[88947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:56 devstack sudo[88945]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 1G" returned: 0 in 0.472s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae1cbe8-2794-474f-abab-598658add5f6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:56 devstack sudo[88952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae1cbe8-2794-474f-abab-598658add5f6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 Apr 13 11:05:56 devstack sudo[88952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:57 devstack sudo[88947]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551" returned: 0 in 0.483s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17cea483-42fe-4c5a-8703-a72086f2a909(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[501a61f9-d100-4386-8a02-e831ccdb40e9]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:57 devstack sudo[88957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 Apr 13 11:05:57 devstack sudo[88957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:57 devstack sudo[88952]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bae1cbe8-2794-474f-abab-598658add5f6 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" returned: 0 in 0.437s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:57 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 is being set with open permissions: ugo+rw Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:57 devstack sudo[88962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 Apr 13 11:05:57 devstack sudo[88962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:57 devstack sudo[88957]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909" returned: 0 in 0.495s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae843c-56af-4f55-b868-acbfc07eed6c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:57 devstack sudo[88962]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" returned: 0 in 0.424s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:57 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d Apr 13 11:05:57 devstack sudo[88969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.info Apr 13 11:05:57 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:57 devstack sudo[88969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:58 devstack sudo[88969]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.info" returned: 0 in 0.407s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:58 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.info is being set with open permissions: ugo+rw Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:58 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17cea483-42fe-4c5a-8703-a72086f2a909(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[17abb210-95bb-4e90-81bf-b97a23220fde]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:58 devstack sudo[88976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.info Apr 13 11:05:58 devstack sudo[88976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:58 devstack sudo[88978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 Apr 13 11:05:58 devstack sudo[88978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:58 devstack sudo[88976]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.info" returned: 0 in 0.396s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.696s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:58 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-295bee02-e6ce-47e6-9640-93620a527f4c tempest-VolumesSnapshotTestJSON-75564979 None] Create snapshot completed successfully Apr 13 11:05:58 devstack sudo[88978]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551" returned: 0 in 0.475s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17cea483-42fe-4c5a-8703-a72086f2a909(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2bb7ea-d567-453b-b2a2-d728ad24d16d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:58 devstack sudo[88984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 Apr 13 11:05:58 devstack sudo[88984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:58 devstack sudo[88984]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909" returned: 0 in 0.465s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:59 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 Apr 13 11:05:59 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (de74aa93-0939-4bcc-b261-e1a7c2974b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:05:59 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225aa1c8-af97-402b-bd29-9b5fe7d59735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (225aa1c8-af97-402b-bd29-9b5fe7d59735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1817104345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=525b84d8-1f85-4ed5-ba2c-893f7ec91e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6664bc4647b14fe9b1001830b6624cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:05:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:05:59Z,use_quota=True,user_id='eca98081421a4f4e998562916183ae8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa8074e-3f6a-4b81-b6f7-4619afa54e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9aa8074e-3f6a-4b81-b6f7-4619afa54e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d18992-32d7-4dd7-9cbf-88f287850fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d18992-32d7-4dd7-9cbf-88f287850fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '525b84d8-1f85-4ed5-ba2c-893f7ec91e94', 'volume_name': 'volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94', 'volume_size': 2, 'snapshot_id': 'ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5457f8f6-061c-4597-ba84-cd054fda69fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5457f8f6-061c-4597-ba84-cd054fda69fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef92e5f-22cf-45ba-9ac1-287a7b2f48f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:05:59 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Volume 525b84d8-1f85-4ed5-ba2c-893f7ec91e94: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94', 'volume_size': 2, 'snapshot_id': 'ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42'} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551" returned: 0 in 0.545s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" by "_create_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:59 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551 Apr 13 11:05:59 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" acquired by "_create_volume_from_snapshot" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Creating volume 525b84d8-1f85-4ed5-ba2c-893f7ec91e94 from snapshot ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 {{(pid=82656) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] snapshot: ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42, volume: 525b84d8-1f85-4ed5-ba2c-893f7ec91e94, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d8c7c74-5239-4ff1-9e47-aa48fc600cd3]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:59 devstack sudo[88996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 Apr 13 11:05:59 devstack sudo[88996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:05:59 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.2ecf0885-37e9-4c72-adae-0f3aec494551" returned: 0 in 0.418s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:05:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d -F qcow2 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:05:59 devstack sudo[88999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d -F qcow2 Apr 13 11:05:59 devstack sudo[88999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:00 devstack sudo[88996]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" returned: 0 in 0.482s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae1cbe8-2794-474f-abab-598658add5f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[199ad7fa-a5ff-4f71-be76-043d01fb0ebc]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:00 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 Apr 13 11:06:00 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:00 devstack sudo[88999]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17cea483-42fe-4c5a-8703-a72086f2a909 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d -F qcow2" returned: 0 in 0.457s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-2ecf0885-37e9-4c72-adae-0f3aec494551" released by "_delete_snapshot" :: held 3.896s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" released by "delete_snapshot" :: held 3.907s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Created reservations ['d2137e7e-5991-4aff-bc89-75dd5ccbf076', '2c27667e-fc9c-4966-99a6-860077de3aa3', 'd8f52bd3-d288-46c2-b313-837ab0b0b334', 'ffc2f6d7-2de8-4350-ae71-cc671cb6d74b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:00 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Delete snapshot completed successfully. Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-2ecf0885-37e9-4c72-adae-0f3aec494551-delete_snapshot" released by "delete_snapshot" :: held 4.005s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-be636d6d-9ac3-471c-ac7b-c4124468b89d-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-be636d6d-9ac3-471c-ac7b-c4124468b89d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-be636d6d-9ac3-471c-ac7b-c4124468b89d" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-be636d6d-9ac3-471c-ac7b-c4124468b89d" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Deleting offline snapshot be636d6d-9ac3-471c-ac7b-c4124468b89d of volume 17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] snapshot_file for this snap is: volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[69a2eb14-269a-4416-a169-ffeaa026cb05]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:00 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6" returned: 0 in 0.519s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:00 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d Apr 13 11:06:00 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:06:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:00 devstack sudo[89014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 Apr 13 11:06:00 devstack sudo[89014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:01 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d" returned: 0 in 0.497s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17cea483-42fe-4c5a-8703-a72086f2a909(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:01 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbd5cba7-7a09-4ddc-9f23-cea52a5d4418]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:01 devstack sudo[89024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 Apr 13 11:06:01 devstack sudo[89024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:02 devstack sudo[89024]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909" returned: 0 in 1.334s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:02 devstack sudo[89035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d Apr 13 11:06:02 devstack sudo[89035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:02 devstack sudo[89014]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" returned: 0 in 1.933s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:02 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[38fac083-71fc-4da0-ac90-ba1a8e92e48c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:02 devstack sudo[89037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 Apr 13 11:06:02 devstack sudo[89037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:02 devstack sudo[89035]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d" returned: 0 in 0.515s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:02 devstack sudo[89042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d Apr 13 11:06:02 devstack sudo[89042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:03 devstack sudo[89037]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6" returned: 0 in 0.654s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:06:03 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Converted 1024.00 MB image at 529.43 MB/s Apr 13 11:06:03 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 is being set with open permissions: ugo+rw Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:03 devstack sudo[89048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 Apr 13 11:06:03 devstack sudo[89048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:03 devstack sudo[89042]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909.be636d6d-9ac3-471c-ac7b-c4124468b89d" returned: 0 in 0.463s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-be636d6d-9ac3-471c-ac7b-c4124468b89d" released by "_delete_snapshot" :: held 2.859s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" released by "delete_snapshot" :: held 2.871s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Created reservations ['28bba9b6-b5f1-41f6-a600-aab38aa32eff', 'e35ace77-67ba-4038-8b93-d416404941e7', 'bbaa01db-0f6a-4e11-85e8-f7ac201654c8', '3b7a104b-b6f7-4c40-aed1-73429910afec'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Delete snapshot completed successfully. Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-be636d6d-9ac3-471c-ac7b-c4124468b89d-delete_snapshot" released by "delete_snapshot" :: held 2.964s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Snapshots deleted, issuing volume delete {{(pid=82656) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" acquired by "delete_volume" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5fd5d88-6e37-4ac1-a431-8bf1e8de26f3]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:03 devstack sudo[89051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 Apr 13 11:06:03 devstack sudo[89051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:03 devstack sudo[89048]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" returned: 0 in 0.425s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" released by "_copy_volume_from_snapshot" :: held 4.082s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" released by "_create_volume_from_snapshot" :: held 4.100s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.112s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ef92e5f-22cf-45ba-9ac1-287a7b2f48f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94', 'volume_size': 2, 'snapshot_id': 'ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80bfeeeb-d8fa-4209-b8c6-617e4dcd5460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:03 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Volume volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 (525b84d8-1f85-4ed5-ba2c-893f7ec91e94): created successfully Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80bfeeeb-d8fa-4209-b8c6-617e4dcd5460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (de74aa93-0939-4bcc-b261-e1a7c2974b85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-72367bbb-93ac-4960-9798-a4b1946958d9 tempest-VolumesSnapshotTestJSON-75564979 None] Created volume successfully. Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-525b84d8-1f85-4ed5-ba2c-893f7ec91e94-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-525b84d8-1f85-4ed5-ba2c-893f7ec91e94-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91f9003-f5eb-4c50-9d55-6ba53f1d989d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:03 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 Apr 13 11:06:03 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:04 devstack sudo[89051]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909" returned: 0 in 0.521s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:04 devstack sudo[89059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909 Apr 13 11:06:04 devstack sudo[89059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:04 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:04 devstack sudo[89065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94 Apr 13 11:06:04 devstack sudo[89065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:04 devstack sudo[89059]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-17cea483-42fe-4c5a-8703-a72086f2a909" returned: 0 in 0.444s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-17cea483-42fe-4c5a-8703-a72086f2a909" released by "delete_volume" :: held 0.994s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Created reservations ['ecd0d95a-c145-4804-a183-1fd5ac32bb6b', '905ef189-fe75-4f29-85cc-6014f80825bd', '37329ef6-be2a-47f9-ba9f-e6adbbbbc13f', '7f6f33ad-69af-416a-b97a-4aeeeea52208'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:04 devstack sudo[89067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:04 devstack sudo[89067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:04 devstack sudo[89065]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" returned: 0 in 0.428s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-525b84d8-1f85-4ed5-ba2c-893f7ec91e94" released by "delete_volume" :: held 0.932s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Created reservations ['13a2356c-9425-4ca0-ac88-45b4468c1eab', '4b9f258b-964b-4cba-bd6d-d7238033ce0c', '2ee2cd53-7023-4177-ad14-7c567761c6c6', 'b1c8f6a4-e63f-4eec-b9ff-54503ee5043a'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:04 devstack sudo[89071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:04 devstack sudo[89071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:04 devstack sudo[89067]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.418s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:04 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Deleted volume successfully. Apr 13 11:06:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-34ee2c08-c4c8-46c2-90a5-55a7992d1134 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-17cea483-42fe-4c5a-8703-a72086f2a909-delete_volume" released by "delete_volume" :: held 8.539s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-bae1cbe8-2794-474f-abab-598658add5f6" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-bae1cbe8-2794-474f-abab-598658add5f6" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Deleting offline snapshot ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 of volume bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] snapshot_file for this snap is: volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ecd063e-5ce6-42b6-9ebc-8e16a365ffb7]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:05 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 Apr 13 11:06:05 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:05 devstack sudo[89071]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.462s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Deleted volume successfully. Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3542d2f5-2d23-4903-99a4-b3f6ba6152ad tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-525b84d8-1f85-4ed5-ba2c-893f7ec91e94-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Flow 'volume_create_manager' (376e6a61-d4ed-4686-a1a5-301e97fbf91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996114e8-e2af-49b6-aa4f-70e486b4b16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (996114e8-e2af-49b6-aa4f-70e486b4b16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-534918416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d285f74-3995-4d91-bd65-bc88a304ce08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdbc3725f624a79b5cbc3e2d86831e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:05Z,use_quota=True,user_id='6781ac82e3a84f6b86e146695ccfafee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa2d523-f8e9-420b-9b03-041790977644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffa2d523-f8e9-420b-9b03-041790977644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096b202c-efd5-4fb7-88e9-c044f978ca65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (096b202c-efd5-4fb7-88e9-c044f978ca65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d285f74-3995-4d91-bd65-bc88a304ce08', 'volume_name': 'volume-7d285f74-3995-4d91-bd65-bc88a304ce08', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6b2bfc-f3d1-4526-a815-d22ae686aaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6b2bfc-f3d1-4526-a815-d22ae686aaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908e79c6-1fb1-44fb-bdeb-56305de6eb17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:05 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Volume 7d285f74-3995-4d91-bd65-bc88a304ce08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d285f74-3995-4d91-bd65-bc88a304ce08', 'volume_size': 1} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-534918416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d285f74-3995-4d91-bd65-bc88a304ce08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdbc3725f624a79b5cbc3e2d86831e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:05Z,use_quota=True,user_id='6781ac82e3a84f6b86e146695ccfafee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Creating volume 7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:05 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:05 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 1073741824 Apr 13 11:06:05 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:05 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" returned: 0 in 0.532s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bae1cbe8-2794-474f-abab-598658add5f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45e0908-9eaf-49c0-80af-0abc6e9c4631]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:05 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 Apr 13 11:06:05 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:05 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 1073741824" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=134,cinder:UPDATE=130,cinder:INSERT=38,cinder:DELETE=9 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=136,cinder:UPDATE=159,cinder:DELETE=12,cinder:INSERT=32 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:06 devstack sudo[89089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 Apr 13 11:06:06 devstack sudo[89089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:06 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:06 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 Apr 13 11:06:06 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:06 devstack sudo[89089]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08" returned: 0 in 0.433s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (908e79c6-1fb1-44fb-bdeb-56305de6eb17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d285f74-3995-4d91-bd65-bc88a304ce08', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15764e97-e30d-43ed-a538-7375e4910286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Volume volume-7d285f74-3995-4d91-bd65-bc88a304ce08 (7d285f74-3995-4d91-bd65-bc88a304ce08): created successfully Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15764e97-e30d-43ed-a538-7375e4910286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Flow 'volume_create_manager' (376e6a61-d4ed-4686-a1a5-301e97fbf91c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:06 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8eba5133-89a5-487c-9970-6508dee024e8 tempest-VolumesDeleteCascade-1527022336 None] Created volume successfully. Apr 13 11:06:06 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" returned: 0 in 0.462s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:06 devstack sudo[89097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42 Apr 13 11:06:06 devstack sudo[89097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:06 devstack sudo[89097]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6.ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" returned: 0 in 0.410s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42" released by "_delete_snapshot" :: held 1.951s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-bae1cbe8-2794-474f-abab-598658add5f6" released by "delete_snapshot" :: held 1.965s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Created reservations ['3304c390-7584-49f2-86ea-78d6760a92ab', '25b42097-4138-4cc3-a7f8-1fbf3153ffe4', 'e39a20e6-8053-444d-8581-9c5aacac95e7', '98fceec6-8e4e-47b8-9665-c3500631d9ec'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:07 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Delete snapshot completed successfully. Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-22288302-00fe-4646-9868-cc339f7ba64b tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-ecd4ebcb-95aa-44f4-b2f7-34d177f5cd42-delete_snapshot" released by "delete_snapshot" :: held 2.057s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-bae1cbe8-2794-474f-abab-598658add5f6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-bae1cbe8-2794-474f-abab-598658add5f6-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-bae1cbe8-2794-474f-abab-598658add5f6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-bae1cbe8-2794-474f-abab-598658add5f6" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3f18eb-444a-4452-878d-b5930035fc33]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:07 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 Apr 13 11:06:07 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Creating offline snapshot 8adeb78c-761b-45b1-8bef-c8a906607ea5 of volume 7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d767456-7b80-4f79-be8c-857e468edaec]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:07 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6" returned: 0 in 0.509s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:07 devstack sudo[89105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 Apr 13 11:06:07 devstack sudo[89105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:07 devstack sudo[89106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6 Apr 13 11:06:07 devstack sudo[89106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:08 devstack sudo[89105]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:08 devstack sudo[89106]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08" returned: 0 in 0.482s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bae1cbe8-2794-474f-abab-598658add5f6" returned: 0 in 0.438s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-bae1cbe8-2794-474f-abab-598658add5f6" released by "delete_volume" :: held 0.978s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:08 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 1G Apr 13 11:06:08 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Created reservations ['760341d5-0474-4681-95f0-54a46f9896e7', 'a4c22f8f-22d7-43a5-ae17-7a441a8bfb02', '9c9b749f-ea49-4b22-b053-e4f63dbf78cc', '6f63ada3-9a1d-4aa0-ab48-8001a96f2696'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:08 devstack sudo[89115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:08 devstack sudo[89115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (908ac834-16e2-433e-a3a5-d6b4487e200c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717c6832-f37d-44ed-9f44-e1cd5e20395e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (717c6832-f37d-44ed-9f44-e1cd5e20395e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1121833802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a0bde4-7334-42c6-ab3c-ae6f832e7538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6664bc4647b14fe9b1001830b6624cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:09Z,use_quota=True,user_id='eca98081421a4f4e998562916183ae8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a843812-d0f6-4687-8fe3-e961138c07c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a843812-d0f6-4687-8fe3-e961138c07c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6386b9d-f60e-4cea-bee5-f3c6f7105d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6386b9d-f60e-4cea-bee5-f3c6f7105d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3a0bde4-7334-42c6-ab3c-ae6f832e7538', 'volume_name': 'volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a30cac-5b77-4838-906a-2a99f6144216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05a30cac-5b77-4838-906a-2a99f6144216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7272ebd6-4e94-41c7-840f-18fbe6c6f5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:08 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Volume a3a0bde4-7334-42c6-ab3c-ae6f832e7538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538', 'volume_size': 1} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:08 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 1G" returned: 0 in 0.549s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d285f74-3995-4d91-bd65-bc88a304ce08 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:08 devstack sudo[89121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d285f74-3995-4d91-bd65-bc88a304ce08 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 Apr 13 11:06:08 devstack sudo[89115]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:08 devstack sudo[89121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.469s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:08 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Deleted volume successfully. Apr 13 11:06:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3edb87b5-fad3-461a-bb58-ceb82447cfac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-bae1cbe8-2794-474f-abab-598658add5f6-delete_volume" released by "delete_volume" :: held 1.582s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:09 devstack sudo[89121]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d285f74-3995-4d91-bd65-bc88a304ce08 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5" returned: 0 in 0.438s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:09 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 is being set with open permissions: ugo+rw Apr 13 11:06:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:09 devstack sudo[89126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 Apr 13 11:06:09 devstack sudo[89126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:09 devstack sudo[89126]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5" returned: 0 in 0.411s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:09 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.info Apr 13 11:06:09 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:10 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.info" returned: 0 in 0.411s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:10 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.info is being set with open permissions: ugo+rw Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:10 devstack sudo[89132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.info Apr 13 11:06:10 devstack sudo[89132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:10 devstack sudo[89132]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.info" returned: 0 in 0.405s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.750s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.778s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1121833802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3a0bde4-7334-42c6-ab3c-ae6f832e7538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6664bc4647b14fe9b1001830b6624cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:09Z,use_quota=True,user_id='eca98081421a4f4e998562916183ae8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Creating volume a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:10 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:10 devstack sudo[89135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 1073741824 Apr 13 11:06:10 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8f6b053d-f03e-4dc7-a6a2-f4d68bdf0411 tempest-VolumesDeleteCascade-1527022336 None] Create snapshot completed successfully Apr 13 11:06:10 devstack sudo[89135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:10 devstack sudo[89135]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 1073741824" returned: 0 in 0.507s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:10 devstack sudo[89140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 Apr 13 11:06:10 devstack sudo[89140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Flow 'volume_create_manager' (b2aca018-5864-4389-813c-92dca02cde6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8f3e27-cabd-4cae-bbac-666531a3bc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c8f3e27-cabd-4cae-bbac-666531a3bc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1840296907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9786289a-f588-46cd-b91f-628e664cdbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9fdbc3725f624a79b5cbc3e2d86831e9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8adeb78c-761b-45b1-8bef-c8a906607ea5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:11Z,use_quota=True,user_id='6781ac82e3a84f6b86e146695ccfafee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff0e991-d66d-47fc-9f45-0d5fd95ef0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ff0e991-d66d-47fc-9f45-0d5fd95ef0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809cedc6-fe50-4110-92a7-a52f3b3c5f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (809cedc6-fe50-4110-92a7-a52f3b3c5f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9786289a-f588-46cd-b91f-628e664cdbda', 'volume_name': 'volume-9786289a-f588-46cd-b91f-628e664cdbda', 'volume_size': 1, 'snapshot_id': '8adeb78c-761b-45b1-8bef-c8a906607ea5'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a6ecbe-a1bb-4b19-880d-34c36fc7a05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48a6ecbe-a1bb-4b19-880d-34c36fc7a05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a5d008-7b6b-48e1-9ec4-5d1ad6eaa11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:11 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Volume 9786289a-f588-46cd-b91f-628e664cdbda: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9786289a-f588-46cd-b91f-628e664cdbda', 'volume_size': 1, 'snapshot_id': '8adeb78c-761b-45b1-8bef-c8a906607ea5'} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:11 devstack sudo[89140]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" returned: 0 in 0.451s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.279s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-8adeb78c-761b-45b1-8bef-c8a906607ea5-9786289a-f588-46cd-b91f-628e664cdbda" by "_create_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7272ebd6-4e94-41c7-840f-18fbe6c6f5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1c0cf0-978a-4284-bd5f-29ae33e3e7a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:11 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Volume volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 (a3a0bde4-7334-42c6-ab3c-ae6f832e7538): created successfully Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df1c0cf0-978a-4284-bd5f-29ae33e3e7a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (908ac834-16e2-433e-a3a5-d6b4487e200c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-8adeb78c-761b-45b1-8bef-c8a906607ea5-9786289a-f588-46cd-b91f-628e664cdbda" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Creating volume 9786289a-f588-46cd-b91f-628e664cdbda from snapshot 8adeb78c-761b-45b1-8bef-c8a906607ea5 {{(pid=82656) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-9786289a-f588-46cd-b91f-628e664cdbda" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-12093e2b-3ee2-4f2b-b6f9-b6536cc47fac tempest-VolumesSnapshotTestJSON-75564979 None] Created volume successfully. Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-9786289a-f588-46cd-b91f-628e664cdbda" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] snapshot: 8adeb78c-761b-45b1-8bef-c8a906607ea5, volume: 9786289a-f588-46cd-b91f-628e664cdbda, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d5c492-3932-4a1e-bb4e-679cc8717870]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:11 devstack sudo[89143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 Apr 13 11:06:11 devstack sudo[89143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:11 devstack sudo[89143]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5" returned: 0 in 0.485s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d285f74-3995-4d91-bd65-bc88a304ce08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7a7aa8-ab97-4931-846a-a95637a451be]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:12 devstack sudo[89149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 Apr 13 11:06:12 devstack sudo[89149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:12 devstack sudo[89149]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08" returned: 0 in 0.471s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:12 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:06:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:12 devstack sudo[89154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda Apr 13 11:06:12 devstack sudo[89154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:14 devstack sudo[89154]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda" returned: 0 in 1.814s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:14 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[88df94dc-0072-4484-be9e-ea689130563d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:14 devstack sudo[89166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 Apr 13 11:06:14 devstack sudo[89166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:14 devstack sudo[89166]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08" returned: 0 in 0.588s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:14 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08, size 1024.00 MB, duration 1.82 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:06:14 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Converted 1024.00 MB image at 564.00 MB/s Apr 13 11:06:14 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda is being set with open permissions: ugo+rw Apr 13 11:06:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:14 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda Apr 13 11:06:14 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:15 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda" returned: 0 in 0.431s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-9786289a-f588-46cd-b91f-628e664cdbda" released by "_copy_volume_from_snapshot" :: held 3.842s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-8adeb78c-761b-45b1-8bef-c8a906607ea5-9786289a-f588-46cd-b91f-628e664cdbda" released by "_create_volume_from_snapshot" :: held 3.865s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.896s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.498s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Creating offline snapshot 10025418-2e35-4a2d-9f04-9235e909c84c of volume a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a5d008-7b6b-48e1-9ec4-5d1ad6eaa11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9786289a-f588-46cd-b91f-628e664cdbda', 'volume_size': 1, 'snapshot_id': '8adeb78c-761b-45b1-8bef-c8a906607ea5'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdad253-2259-4481-a2a0-347bffa5ba45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[03840931-f682-4f2d-bb37-272978ce0a9b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:15 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Volume volume-9786289a-f588-46cd-b91f-628e664cdbda (9786289a-f588-46cd-b91f-628e664cdbda): created successfully Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdad253-2259-4481-a2a0-347bffa5ba45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Flow 'volume_create_manager' (b2aca018-5864-4389-813c-92dca02cde6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:15 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5a27a669-d918-43eb-b3cc-05617a52b72a tempest-VolumesDeleteCascade-1527022336 None] Created volume successfully. Apr 13 11:06:15 devstack sudo[89174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 Apr 13 11:06:15 devstack sudo[89174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:15 devstack sudo[89174]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" returned: 0 in 0.476s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:15 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c 1G Apr 13 11:06:15 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:16 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c 1G" returned: 0 in 0.473s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:16 devstack sudo[89184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c Apr 13 11:06:16 devstack sudo[89184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-7d285f74-3995-4d91-bd65-bc88a304ce08-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-7d285f74-3995-4d91-bd65-bc88a304ce08-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Performing cascade delete. {{(pid=82656) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-8adeb78c-761b-45b1-8bef-c8a906607ea5-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-8adeb78c-761b-45b1-8bef-c8a906607ea5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-7d285f74-3995-4d91-bd65-bc88a304ce08" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-7d285f74-3995-4d91-bd65-bc88a304ce08" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-8adeb78c-761b-45b1-8bef-c8a906607ea5" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-8adeb78c-761b-45b1-8bef-c8a906607ea5" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Deleting offline snapshot 8adeb78c-761b-45b1-8bef-c8a906607ea5 of volume 7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] snapshot_file for this snap is: volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f72ae19-d0ac-4f12-b972-2f9e33c19448]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:16 devstack sudo[89186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 Apr 13 11:06:16 devstack sudo[89186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:16 devstack sudo[89184]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:16 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c is being set with open permissions: ugo+rw Apr 13 11:06:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:16 devstack sudo[89191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c Apr 13 11:06:16 devstack sudo[89191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:17 devstack sudo[89186]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d285f74-3995-4d91-bd65-bc88a304ce08(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6609f90-5dfd-443a-99b6-af1ba83e38b2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:17 devstack sudo[89196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 Apr 13 11:06:17 devstack sudo[89196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:17 devstack sudo[89191]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c" returned: 0 in 0.429s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:17 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.info Apr 13 11:06:17 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:17 devstack sudo[89196]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08" returned: 0 in 0.495s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:17 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 Apr 13 11:06:17 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:17 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.info" returned: 0 in 0.436s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:17 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.info is being set with open permissions: ugo+rw Apr 13 11:06:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:17 devstack sudo[89207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.info Apr 13 11:06:17 devstack sudo[89207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:18 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5" returned: 0 in 0.483s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:18 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5 Apr 13 11:06:18 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:18 devstack sudo[89207]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.info" returned: 0 in 0.423s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.775s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-50abdc44-50e8-423b-b951-1f907bb7e180 tempest-VolumesSnapshotTestJSON-75564979 None] Create snapshot completed successfully Apr 13 11:06:18 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08.8adeb78c-761b-45b1-8bef-c8a906607ea5" returned: 0 in 0.434s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-8adeb78c-761b-45b1-8bef-c8a906607ea5" released by "_delete_snapshot" :: held 1.946s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-7d285f74-3995-4d91-bd65-bc88a304ce08" released by "delete_snapshot" :: held 1.958s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Created reservations ['58831dff-186a-43b7-96f9-4257482bb104', '3c458cea-70bf-4d34-8497-834df147ff39', '60899c60-c5bd-4f71-ad15-a49b9b137301', '970e6b8c-8ba1-48fa-8193-7364e61a2ea4'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Delete snapshot completed successfully. Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-8adeb78c-761b-45b1-8bef-c8a906607ea5-delete_snapshot" released by "delete_snapshot" :: held 2.072s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Snapshots deleted, issuing volume delete {{(pid=82656) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-7d285f74-3995-4d91-bd65-bc88a304ce08" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-7d285f74-3995-4d91-bd65-bc88a304ce08" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa06c174-f629-4c0a-a270-1e284bf368f3]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:18 devstack sudo[89216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 Apr 13 11:06:18 devstack sudo[89216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:19 devstack sudo[89216]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08" returned: 0 in 0.499s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:19 devstack sudo[89222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08 Apr 13 11:06:19 devstack sudo[89222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (a7f8232b-5f46-4636-ae73-8278b795bc15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49de32e8-813a-4925-b92b-fb597de12ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49de32e8-813a-4925-b92b-fb597de12ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1934866608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2742e7fb-6c06-4956-a6c3-350fba3a3028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6664bc4647b14fe9b1001830b6624cae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=10025418-2e35-4a2d-9f04-9235e909c84c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:19Z,use_quota=True,user_id='eca98081421a4f4e998562916183ae8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a48d921-5412-44c4-9361-6c7f427f18f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a48d921-5412-44c4-9361-6c7f427f18f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b763d85-9410-4399-990a-b8e00c7dbae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b763d85-9410-4399-990a-b8e00c7dbae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2742e7fb-6c06-4956-a6c3-350fba3a3028', 'volume_name': 'volume-2742e7fb-6c06-4956-a6c3-350fba3a3028', 'volume_size': 1, 'snapshot_id': '10025418-2e35-4a2d-9f04-9235e909c84c'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a2fa4f-aa61-499f-b6a9-3edbecb1dbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11a2fa4f-aa61-499f-b6a9-3edbecb1dbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9630fe-6387-4198-810a-b2dd45d2474c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:19 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Volume 2742e7fb-6c06-4956-a6c3-350fba3a3028: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2742e7fb-6c06-4956-a6c3-350fba3a3028', 'volume_size': 1, 'snapshot_id': '10025418-2e35-4a2d-9f04-9235e909c84c'} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-10025418-2e35-4a2d-9f04-9235e909c84c-2742e7fb-6c06-4956-a6c3-350fba3a3028" by "_create_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-10025418-2e35-4a2d-9f04-9235e909c84c-2742e7fb-6c06-4956-a6c3-350fba3a3028" acquired by "_create_volume_from_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Creating volume 2742e7fb-6c06-4956-a6c3-350fba3a3028 from snapshot 10025418-2e35-4a2d-9f04-9235e909c84c {{(pid=82656) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-2742e7fb-6c06-4956-a6c3-350fba3a3028" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-2742e7fb-6c06-4956-a6c3-350fba3a3028" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] snapshot: 10025418-2e35-4a2d-9f04-9235e909c84c, volume: 2742e7fb-6c06-4956-a6c3-350fba3a3028, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa7751b-22c5-4c9d-802a-6b6bdf661f94]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:19 devstack sudo[89225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c Apr 13 11:06:19 devstack sudo[89225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:19 devstack sudo[89222]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7d285f74-3995-4d91-bd65-bc88a304ce08" returned: 0 in 0.486s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-7d285f74-3995-4d91-bd65-bc88a304ce08" released by "delete_volume" :: held 1.026s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Created reservations ['c1572809-8dbb-41fc-a40b-e5a417dfc5a4', '17c3ac39-9abe-4b00-8a6b-f47eeeaf2c7e', 'dedc6510-34a2-48d3-a381-736d846fd2cf', 'e7b3d701-b265-4f1d-b98a-0bac1949612f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:19 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:19 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:20 devstack sudo[89225]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cef7cd-24e2-4941-bed0-fc9d9cbe40a0]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:20 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 Apr 13 11:06:20 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:20 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.439s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:20 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Deleted volume successfully. Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-651ca300-a9d3-481e-b415-4af32a2de310 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-7d285f74-3995-4d91-bd65-bc88a304ce08-delete_volume" released by "delete_volume" :: held 3.712s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:20 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" returned: 0 in 0.492s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:20 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 Apr 13 11:06:20 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-9786289a-f588-46cd-b91f-628e664cdbda-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-9786289a-f588-46cd-b91f-628e664cdbda-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "cinder-quobyte-9786289a-f588-46cd-b91f-628e664cdbda" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-9786289a-f588-46cd-b91f-628e664cdbda" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[850bf629-bc84-4640-9cdb-eb8fbb1f804e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:21 devstack sudo[89243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda Apr 13 11:06:21 devstack sudo[89243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:21 devstack sudo[89243]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda" returned: 0 in 0.995s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:21 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda Apr 13 11:06:21 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:22 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9786289a-f588-46cd-b91f-628e664cdbda" returned: 0 in 0.685s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-quobyte-9786289a-f588-46cd-b91f-628e664cdbda" released by "delete_volume" :: held 1.702s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:22 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Created reservations ['4927f290-cf23-4dbd-a966-4a65503bf157', '9b3737fe-8aa1-4254-9f04-93558d8073fc', 'eb5a13e3-d506-4c1c-8ff2-282c2b2bc398', '60451239-82f2-49b5-9d0d-70abcf14fa6c'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028" returned: 0 in 2.132s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4f3951-8b22-4cdb-b7c9-8c415c7c73df]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:22 devstack sudo[89266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 Apr 13 11:06:22 devstack sudo[89266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:22 devstack sudo[89267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:22 devstack sudo[89267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:23 devstack sudo[89267]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.411s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Deleted volume successfully. Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-3880dc39-4e4d-458f-a816-e0c5176e65f4 tempest-VolumesDeleteCascade-1527022336 None] Lock "cinder-9786289a-f588-46cd-b91f-628e664cdbda-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:23 devstack sudo[89266]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" returned: 0 in 0.656s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538, size 1024.00 MB, duration 2.13 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:06:23 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Converted 1024.00 MB image at 480.21 MB/s Apr 13 11:06:23 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 is being set with open permissions: ugo+rw Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:23 devstack sudo[89274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 Apr 13 11:06:23 devstack sudo[89274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:23 devstack sudo[89274]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028" returned: 0 in 0.504s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-2742e7fb-6c06-4956-a6c3-350fba3a3028" released by "_copy_volume_from_snapshot" :: held 4.331s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-10025418-2e35-4a2d-9f04-9235e909c84c-2742e7fb-6c06-4956-a6c3-350fba3a3028" released by "_create_volume_from_snapshot" :: held 4.349s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.358s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f9630fe-6387-4198-810a-b2dd45d2474c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2742e7fb-6c06-4956-a6c3-350fba3a3028', 'volume_size': 1, 'snapshot_id': '10025418-2e35-4a2d-9f04-9235e909c84c'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de09667d-70b2-454b-9be2-69fa9c8c86b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:23 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Volume volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 (2742e7fb-6c06-4956-a6c3-350fba3a3028): created successfully Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de09667d-70b2-454b-9be2-69fa9c8c86b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:23 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Flow 'volume_create_manager' (a7f8232b-5f46-4636-ae73-8278b795bc15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9630c498-66ec-47a9-8fda-96e3ce32a6ca tempest-VolumesSnapshotTestJSON-75564979 None] Created volume successfully. Apr 13 11:06:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-2742e7fb-6c06-4956-a6c3-350fba3a3028-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-2742e7fb-6c06-4956-a6c3-350fba3a3028-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-2742e7fb-6c06-4956-a6c3-350fba3a3028" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-2742e7fb-6c06-4956-a6c3-350fba3a3028" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:24 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2a1af3-6ad4-4d9c-a83d-f2e3e4b29507]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:24 devstack sudo[89278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 Apr 13 11:06:24 devstack sudo[89278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:25 devstack sudo[89278]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028" returned: 0 in 0.561s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:25 devstack sudo[89283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028 Apr 13 11:06:25 devstack sudo[89283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Flow 'volume_create_manager' (93d86d4f-297a-4c6b-adf5-b28c512733c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6335e29-02be-49b2-bd1f-89652852acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6335e29-02be-49b2-bd1f-89652852acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-768525905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c274c841-0e4b-4e43-aa23-48e82dbfe38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b12acbd4bc54ed9a996cdd59579c247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:26Z,use_quota=True,user_id='4761342f2f0c4d76a193dc253ecc43c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b12f7b6-5322-4caf-9740-1702edb7c657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b12f7b6-5322-4caf-9740-1702edb7c657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98fadd5-1ba8-4f25-a87d-02fd35f293b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98fadd5-1ba8-4f25-a87d-02fd35f293b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c274c841-0e4b-4e43-aa23-48e82dbfe38a', 'volume_name': 'volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0503942-1cf1-4610-98dc-474d7cea1c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0503942-1cf1-4610-98dc-474d7cea1c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b38501-1e54-4c57-a1bf-e7a9c62f7f23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:25 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Volume c274c841-0e4b-4e43-aa23-48e82dbfe38a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a', 'volume_size': 1} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-768525905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c274c841-0e4b-4e43-aa23-48e82dbfe38a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b12acbd4bc54ed9a996cdd59579c247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:26Z,use_quota=True,user_id='4761342f2f0c4d76a193dc253ecc43c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Creating volume c274c841-0e4b-4e43-aa23-48e82dbfe38a {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:25 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:25 devstack sudo[89285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a 1073741824 Apr 13 11:06:25 devstack sudo[89285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:25 devstack sudo[89283]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-2742e7fb-6c06-4956-a6c3-350fba3a3028" returned: 0 in 0.468s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-2742e7fb-6c06-4956-a6c3-350fba3a3028" released by "delete_volume" :: held 1.066s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Created reservations ['96efe221-2cac-4719-a4da-57bca2d9199f', '2c6ea65c-d5c7-4145-afee-2e8ecacdb3b1', 'e21b1596-19f2-4084-b0fd-ddb2dbc101ec', 'bb65f618-3910-4758-8405-0e86b83536f2'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:25 devstack sudo[89288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:25 devstack sudo[89288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:26 devstack sudo[89285]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a 1073741824" returned: 0 in 0.512s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:26 devstack sudo[89293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a Apr 13 11:06:26 devstack sudo[89293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:26 devstack sudo[89288]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.458s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:26 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Deleted volume successfully. Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4b1f8a48-da2e-40de-b39c-12fe7ee797af tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-2742e7fb-6c06-4956-a6c3-350fba3a3028-delete_volume" released by "delete_volume" :: held 1.653s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:26 devstack sudo[89293]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a" returned: 0 in 0.427s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79b38501-1e54-4c57-a1bf-e7a9c62f7f23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a0421d-2365-4b38-9f59-520294bd94d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:26 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Volume volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a (c274c841-0e4b-4e43-aa23-48e82dbfe38a): created successfully Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36a0421d-2365-4b38-9f59-520294bd94d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Flow 'volume_create_manager' (93d86d4f-297a-4c6b-adf5-b28c512733c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:26 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-caa3f4d1-2def-4b51-ba41-581b44e12e0d tempest-VolumesTransfersV355Test-136629722 None] Created volume successfully. Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-10025418-2e35-4a2d-9f04-9235e909c84c-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-10025418-2e35-4a2d-9f04-9235e909c84c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-10025418-2e35-4a2d-9f04-9235e909c84c" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-10025418-2e35-4a2d-9f04-9235e909c84c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Deleting offline snapshot 10025418-2e35-4a2d-9f04-9235e909c84c of volume a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] snapshot_file for this snap is: volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd627c4a-70b8-4407-afbd-71cee0882134]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:27 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c Apr 13 11:06:27 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:27 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c" returned: 0 in 0.485s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e69f761a-1330-451c-9531-34b74606372e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:27 devstack sudo[89302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 Apr 13 11:06:27 devstack sudo[89302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:28 devstack sudo[89302]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" returned: 0 in 0.506s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:28 devstack sudo[89307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c Apr 13 11:06:28 devstack sudo[89307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:28 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b7b843a1-cc8e-4ca0-947a-3962dfd41daa tempest-VolumesTransfersV355Test-908473244 None] Transfer volume completed successfully. Apr 13 11:06:28 devstack sudo[89307]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c" returned: 0 in 0.445s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:28 devstack sudo[89312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c Apr 13 11:06:28 devstack sudo[89312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:28 devstack sudo[89312]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538.10025418-2e35-4a2d-9f04-9235e909c84c" returned: 0 in 0.444s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-10025418-2e35-4a2d-9f04-9235e909c84c" released by "_delete_snapshot" :: held 1.935s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:28 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" released by "delete_snapshot" :: held 1.949s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Acquiring lock "cinder-c274c841-0e4b-4e43-aa23-48e82dbfe38a-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Created reservations ['62171f36-cc2d-4077-9561-4998ba74dbea', '5e25068c-cabd-46f0-872d-9a88e6945175', '73279cf4-4179-4582-b9df-913aadea7cf3', '79dfcbfd-df2f-4473-b3ac-e1bda5144620'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Lock "cinder-c274c841-0e4b-4e43-aa23-48e82dbfe38a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Acquiring lock "cinder-quobyte-c274c841-0e4b-4e43-aa23-48e82dbfe38a" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Lock "cinder-quobyte-c274c841-0e4b-4e43-aa23-48e82dbfe38a" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc970486-b488-4644-ac31-8687e2eb1082]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:29 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Delete snapshot completed successfully. Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9fe526f4-a997-4906-aef5-f4dc75759403 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-10025418-2e35-4a2d-9f04-9235e909c84c-delete_snapshot" released by "delete_snapshot" :: held 2.103s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:29 devstack sudo[89315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a Apr 13 11:06:29 devstack sudo[89315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-a3a0bde4-7334-42c6-ab3c-ae6f832e7538-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-a3a0bde4-7334-42c6-ab3c-ae6f832e7538-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a56b838-d528-475c-bd1f-35b6947e37b4]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:29 devstack sudo[89317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 Apr 13 11:06:29 devstack sudo[89317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:29 devstack sudo[89315]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a" returned: 0 in 0.498s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:29 devstack sudo[89322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a Apr 13 11:06:29 devstack sudo[89322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:29 devstack sudo[89317]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" returned: 0 in 0.490s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:29 devstack sudo[89327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538 Apr 13 11:06:29 devstack sudo[89327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:30 devstack sudo[89322]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c274c841-0e4b-4e43-aa23-48e82dbfe38a" returned: 0 in 0.417s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Lock "cinder-quobyte-c274c841-0e4b-4e43-aa23-48e82dbfe38a" released by "delete_volume" :: held 0.946s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Created reservations ['93df613b-40ca-4f61-9570-8beb7e04b67b', 'e108e983-8d4d-4d4f-b1f2-ad33f11b121f', '4607248e-67f3-4682-8fd0-3a3a86850089', '10739850-426d-48f4-bbe8-83b3e4becc43'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:30 devstack sudo[89331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:30 devstack sudo[89331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:30 devstack sudo[89327]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" returned: 0 in 0.435s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-a3a0bde4-7334-42c6-ab3c-ae6f832e7538" released by "delete_volume" :: held 0.957s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Created reservations ['d5f02464-a0f7-4e46-9808-ae353fd63aff', '03873e6b-d129-4f7c-9a2b-81c94748e477', '85627831-3da1-4299-ae29-b445b77f0106', 'bee72e7b-3a59-461f-81b1-24f27c6c6e86'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:30 devstack sudo[89333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:30 devstack sudo[89333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "cinder-quobyte-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Flow 'volume_create_manager' (a10a3b8e-d5f1-4462-86f6-103f1b13c5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0191a3f1-fb8d-4f0e-80e2-8941cb26c937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" acquired by "delete_volume" :: waited 0.036s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0191a3f1-fb8d-4f0e-80e2-8941cb26c937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-594365738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da51eca6-bdeb-4038-9436-74bc133bb72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b12acbd4bc54ed9a996cdd59579c247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:30Z,use_quota=True,user_id='4761342f2f0c4d76a193dc253ecc43c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabac6d7-9e42-4914-8fdd-1062e6ab4131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cabac6d7-9e42-4914-8fdd-1062e6ab4131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70143dbf-d781-4b39-94f3-340f736b5af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70143dbf-d781-4b39-94f3-340f736b5af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da51eca6-bdeb-4038-9436-74bc133bb72e', 'volume_name': 'volume-da51eca6-bdeb-4038-9436-74bc133bb72e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa238fb-d01d-4915-8088-713d2829a856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aa238fb-d01d-4915-8088-713d2829a856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34589e23-0706-421c-926f-e2313724c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:30 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Volume da51eca6-bdeb-4038-9436-74bc133bb72e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da51eca6-bdeb-4038-9436-74bc133bb72e', 'volume_size': 1} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-594365738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da51eca6-bdeb-4038-9436-74bc133bb72e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b12acbd4bc54ed9a996cdd59579c247',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:30Z,use_quota=True,user_id='4761342f2f0c4d76a193dc253ecc43c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Creating volume da51eca6-bdeb-4038-9436-74bc133bb72e {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:30 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7186ad-2af4-4598-865a-064c9495ef53]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:30 devstack sudo[89335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e 1073741824 Apr 13 11:06:30 devstack sudo[89335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:30 devstack sudo[89337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f Apr 13 11:06:30 devstack sudo[89337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:30 devstack sudo[89331]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.564s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:30 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Deleted volume successfully. Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8312c9f7-4bb0-49f3-8ba4-29b2cdaa03ac tempest-VolumesTransfersV355Test-1344844000 None] Lock "cinder-c274c841-0e4b-4e43-aa23-48e82dbfe38a-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:30 devstack sudo[89333]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.511s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:30 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Deleted volume successfully. Apr 13 11:06:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf434c6d-87fe-44e2-a7c2-847e2a115c9e tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-a3a0bde4-7334-42c6-ab3c-ae6f832e7538-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:31 devstack sudo[89335]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e 1073741824" returned: 0 in 0.503s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:31 devstack sudo[89347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e Apr 13 11:06:31 devstack sudo[89347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:31 devstack sudo[89337]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" returned: 0 in 0.531s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:31 devstack sudo[89349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f Apr 13 11:06:31 devstack sudo[89349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:31 devstack sudo[89347]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e" returned: 0 in 0.438s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34589e23-0706-421c-926f-e2313724c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da51eca6-bdeb-4038-9436-74bc133bb72e', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:31 devstack sudo[89349]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7727eb5d-3330-4d05-a4dd-6d7da6d6c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" returned: 0 in 0.439s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Volume volume-da51eca6-bdeb-4038-9436-74bc133bb72e (da51eca6-bdeb-4038-9436-74bc133bb72e): created successfully Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7727eb5d-3330-4d05-a4dd-6d7da6d6c972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Flow 'volume_create_manager' (a10a3b8e-d5f1-4462-86f6-103f1b13c5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-quobyte-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f" released by "delete_volume" :: held 1.056s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:31 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-dbc1912b-5af9-4966-a9c8-a3ac4338bd66 tempest-VolumesTransfersV355Test-136629722 None] Created volume successfully. Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Created reservations ['0cad807f-d1bc-4f64-816f-5c3cc04849df', 'dad5d6f7-f63d-41e6-b36c-68bef3854e62', '7555ab81-8f74-4752-b2fc-4b34618daf81', '1329d622-ce4d-417a-803c-d19e81845491'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:31 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:31 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:32 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.405s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:32 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Deleted volume successfully. Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-ac05c214-7dd8-429a-877e-5e60238c2004 tempest-VolumesSnapshotTestJSON-75564979 None] Lock "cinder-ca869c3a-9ed7-40fc-8d8c-73b3cf95a76f-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Acquiring lock "cinder-da51eca6-bdeb-4038-9436-74bc133bb72e-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Lock "cinder-da51eca6-bdeb-4038-9436-74bc133bb72e-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Acquiring lock "cinder-quobyte-da51eca6-bdeb-4038-9436-74bc133bb72e" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Lock "cinder-quobyte-da51eca6-bdeb-4038-9436-74bc133bb72e" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb770bb-a390-41b8-a58e-0a72b0c537e4]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:32 devstack sudo[89357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e Apr 13 11:06:32 devstack sudo[89357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:33 devstack sudo[89357]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e" returned: 0 in 0.536s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:33 devstack sudo[89362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e Apr 13 11:06:33 devstack sudo[89362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:33 devstack sudo[89362]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-da51eca6-bdeb-4038-9436-74bc133bb72e" returned: 0 in 0.490s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Lock "cinder-quobyte-da51eca6-bdeb-4038-9436-74bc133bb72e" released by "delete_volume" :: held 1.052s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:33 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Created reservations ['0a49af01-bc54-4b46-b871-f105feea70a7', 'ca56d50f-f596-49b6-a8fb-e9419a0fd1e0', '3af72a1c-b767-4396-9709-f75dda08bf8d', '50f8b752-f2dd-4a0d-b83d-55014115e473'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:34 devstack sudo[89366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:34 devstack sudo[89366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:34 devstack sudo[89366]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.451s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:34 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Deleted volume successfully. Apr 13 11:06:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-911bc39c-7f9f-437b-8b43-c4ec23975b4a tempest-VolumesTransfersV355Test-1344844000 None] Lock "cinder-da51eca6-bdeb-4038-9436-74bc133bb72e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (b6fdca31-49b8-4e66-9159-10c6dc29fff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52b72df-bc86-475d-88bb-f33ff4f83acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f52b72df-bc86-475d-88bb-f33ff4f83acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1678912881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863ef94c-e745-45df-915c-e1e2853ce1a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:38Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0da8038-4506-41ba-80f0-52a1e734f04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0da8038-4506-41ba-80f0-52a1e734f04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fcff7c-8b71-431e-b722-5fe39fabda7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79fcff7c-8b71-431e-b722-5fe39fabda7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '863ef94c-e745-45df-915c-e1e2853ce1a4', 'volume_name': 'volume-863ef94c-e745-45df-915c-e1e2853ce1a4', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0b6159-5aee-4505-9420-1023ad795824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0b6159-5aee-4505-9420-1023ad795824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7cf3ff-bb43-4d67-bacd-051a282b07d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Volume 863ef94c-e745-45df-915c-e1e2853ce1a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-863ef94c-e745-45df-915c-e1e2853ce1a4', 'volume_size': 1} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1678912881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863ef94c-e745-45df-915c-e1e2853ce1a4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:38Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Creating volume 863ef94c-e745-45df-915c-e1e2853ce1a4 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:38 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:38 devstack sudo[89370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 1073741824 Apr 13 11:06:38 devstack sudo[89370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:38 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:38 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:38 devstack sudo[89370]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 1073741824" returned: 0 in 0.519s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:38 devstack sudo[89377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 Apr 13 11:06:38 devstack sudo[89377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:39 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.425s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:39 devstack sudo[89377]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4" returned: 0 in 0.442s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7cf3ff-bb43-4d67-bacd-051a282b07d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-863ef94c-e745-45df-915c-e1e2853ce1a4', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51f93ac-7063-4d16-9b93-04e0661cdb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:39 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Volume volume-863ef94c-e745-45df-915c-e1e2853ce1a4 (863ef94c-e745-45df-915c-e1e2853ce1a4): created successfully Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e51f93ac-7063-4d16-9b93-04e0661cdb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (b6fdca31-49b8-4e66-9159-10c6dc29fff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:39 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-25dbc3e2-aa18-4c13-8a43-223513c00c57 tempest-VolumesGetTest-337536183 None] Created volume successfully. Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (ad5f21b8-1db9-4fb7-b20a-793cf07a33fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dfc1c3-77da-4d0e-805e-3674be66f72a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80dfc1c3-77da-4d0e-805e-3674be66f72a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-57845699',display_name='tempest-VolumesGetTest-Volume-739524043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58383e56-b977-4409-b0e2-f09e016e8359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:41Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08213eb7-3ee9-4431-8658-58795a44f266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08213eb7-3ee9-4431-8658-58795a44f266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d48ba3-19ba-42e6-9853-35825a41e934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d48ba3-19ba-42e6-9853-35825a41e934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58383e56-b977-4409-b0e2-f09e016e8359', 'volume_name': 'volume-58383e56-b977-4409-b0e2-f09e016e8359', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecac960-a697-421a-a75d-28a52a49d443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fecac960-a697-421a-a75d-28a52a49d443) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41aeb481-83cb-498d-93f3-8dff28d1d55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:40 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Volume 58383e56-b977-4409-b0e2-f09e016e8359: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58383e56-b977-4409-b0e2-f09e016e8359', 'volume_size': 1} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-57845699',display_name='tempest-VolumesGetTest-Volume-739524043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58383e56-b977-4409-b0e2-f09e016e8359,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:41Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Creating volume 58383e56-b977-4409-b0e2-f09e016e8359 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:40 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:06:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:40 devstack sudo[89415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 1073741824 Apr 13 11:06:40 devstack sudo[89415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:41 devstack sudo[89415]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 1073741824" returned: 0 in 0.484s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:41 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 Apr 13 11:06:41 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:41 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359" returned: 0 in 0.402s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.918s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41aeb481-83cb-498d-93f3-8dff28d1d55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58383e56-b977-4409-b0e2-f09e016e8359', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c321529c-0b41-4ef2-9445-3bb5407e6b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:41 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Volume volume-58383e56-b977-4409-b0e2-f09e016e8359 (58383e56-b977-4409-b0e2-f09e016e8359): created successfully Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c321529c-0b41-4ef2-9445-3bb5407e6b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:41 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (ad5f21b8-1db9-4fb7-b20a-793cf07a33fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:41 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-fc042d88-69f5-4ae7-8de1-7d7c1daf6faf tempest-VolumesGetTest-337536183 None] Created volume successfully. Apr 13 11:06:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-58383e56-b977-4409-b0e2-f09e016e8359-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Lock "cinder-58383e56-b977-4409-b0e2-f09e016e8359-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-58383e56-b977-4409-b0e2-f09e016e8359" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-58383e56-b977-4409-b0e2-f09e016e8359" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:43 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7d624d-d708-4dc6-8ed4-75541a036de5]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:43 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 Apr 13 11:06:43 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:43 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359" returned: 0 in 0.463s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:43 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359 Apr 13 11:06:43 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:44 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-58383e56-b977-4409-b0e2-f09e016e8359" returned: 0 in 0.407s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-58383e56-b977-4409-b0e2-f09e016e8359" released by "delete_volume" :: held 0.898s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Created reservations ['6ebe8297-488e-42fb-b7ac-5669cb61f2fd', 'afdd6467-ce66-470a-ae58-54a3aa184d80', 'd1bffec5-3bf1-4360-8954-af5cb0fdc0b8', 'db08938e-0a58-4db6-8697-c91b8995c28e'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:44 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:44 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-863ef94c-e745-45df-915c-e1e2853ce1a4-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Lock "cinder-863ef94c-e745-45df-915c-e1e2853ce1a4-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-863ef94c-e745-45df-915c-e1e2853ce1a4" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-863ef94c-e745-45df-915c-e1e2853ce1a4" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d5d05b5-3c6c-497b-a57d-fe49fe250906]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:44 devstack sudo[89436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 Apr 13 11:06:44 devstack sudo[89436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:44 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.447s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:44 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Deleted volume successfully. Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-db47aa5a-c251-4db6-a52d-6f2735ce87a1 tempest-VolumesGetTest-337536183 None] Lock "cinder-58383e56-b977-4409-b0e2-f09e016e8359-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:44 devstack sudo[89436]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4" returned: 0 in 0.479s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:44 devstack sudo[89442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4 Apr 13 11:06:44 devstack sudo[89442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:45 devstack sudo[89442]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-863ef94c-e745-45df-915c-e1e2853ce1a4" returned: 0 in 0.405s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-863ef94c-e745-45df-915c-e1e2853ce1a4" released by "delete_volume" :: held 0.917s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Created reservations ['936de058-1895-4949-91bb-db822b19d484', '4ef377b7-5e5e-4b8b-989f-0e8326d635d2', 'f8954610-f9f8-457d-8224-8c41c06faaa3', '46f84125-62af-4cb9-ab42-826fc5a4f2e9'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:45 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:45 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (31dea795-cee8-4cf3-906c-cff7f5299726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbc1641-cb07-4c7f-b93d-642f1f491e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbc1641-cb07-4c7f-b93d-642f1f491e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-5229267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a973d9-23b1-4043-8af0-ef1c396d3d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:46Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d9504c-4817-4e6e-bf3b-b69a0055c09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66d9504c-4817-4e6e-bf3b-b69a0055c09f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c901f5-f308-48ff-bb65-e62755b348b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2c901f5-f308-48ff-bb65-e62755b348b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88a973d9-23b1-4043-8af0-ef1c396d3d9b', 'volume_name': 'volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ada0b0-bbfd-4501-a1c2-5f995c8256dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ada0b0-bbfd-4501-a1c2-5f995c8256dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a88fbe6-c5bf-4785-9d76-c35554aa1d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:45 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Volume 88a973d9-23b1-4043-8af0-ef1c396d3d9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b', 'volume_size': 1} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-5229267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88a973d9-23b1-4043-8af0-ef1c396d3d9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:46Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Creating volume 88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:45 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:45 devstack sudo[89448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b 1073741824 Apr 13 11:06:45 devstack sudo[89448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:45 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.446s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Deleted volume successfully. Apr 13 11:06:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bcf8d524-b6d5-47f0-a5e3-214da6f8380a tempest-VolumesGetTest-337536183 None] Lock "cinder-863ef94c-e745-45df-915c-e1e2853ce1a4-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:46 devstack sudo[89448]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b 1073741824" returned: 0 in 0.491s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:46 devstack sudo[89453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b Apr 13 11:06:46 devstack sudo[89453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:46 devstack sudo[89453]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b" returned: 0 in 0.403s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a88fbe6-c5bf-4785-9d76-c35554aa1d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a23353-c2a6-4ff3-aec2-79a5d64f2523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:46 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Volume volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b (88a973d9-23b1-4043-8af0-ef1c396d3d9b): created successfully Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9a23353-c2a6-4ff3-aec2-79a5d64f2523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (31dea795-cee8-4cf3-906c-cff7f5299726) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:46 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-7e9dcf55-3884-41ee-9a79-2fb4b89992be tempest-VolumesGetTest-337536183 None] Created volume successfully. Apr 13 11:06:47 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (9589684b-b726-42d0-b371-9fd4d8f8bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a91e65-e715-47e6-bf62-c47847934d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18a91e65-e715-47e6-bf62-c47847934d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-526712936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c64911a-d329-47dc-9647-9fd24ba81cda,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=88a973d9-23b1-4043-8af0-ef1c396d3d9b,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:48Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21225fc-5987-419a-ab06-d19baa7f681b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f21225fc-5987-419a-ab06-d19baa7f681b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd2c7d4-0246-4c2f-8823-e69573de0839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cd2c7d4-0246-4c2f-8823-e69573de0839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9c64911a-d329-47dc-9647-9fd24ba81cda', 'volume_name': 'volume-9c64911a-d329-47dc-9647-9fd24ba81cda', 'volume_size': 1, 'source_volid': '88a973d9-23b1-4043-8af0-ef1c396d3d9b', 'source_volstatus': 'available'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5915fb-ee85-4319-845c-301701704556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f5915fb-ee85-4319-845c-301701704556) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a95f85-3512-43a8-be70-d3bfd4d825cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Volume 9c64911a-d329-47dc-9647-9fd24ba81cda: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9c64911a-d329-47dc-9647-9fd24ba81cda', 'volume_size': 1, 'source_volid': '88a973d9-23b1-4043-8af0-ef1c396d3d9b', 'source_volstatus': 'available'} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:48 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Cloning volume 88a973d9-23b1-4043-8af0-ef1c396d3d9b to volume 9c64911a-d329-47dc-9647-9fd24ba81cda Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Creating offline snapshot 8f4973b1-727d-4e81-b426-ca4338811363 of volume 88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32ed234-f6c4-48a2-9f2d-4dcfa78683de]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:48 devstack sudo[89456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b Apr 13 11:06:48 devstack sudo[89456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:48 devstack sudo[89456]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b" returned: 0 in 0.471s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:48 devstack sudo[89461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 1G Apr 13 11:06:48 devstack sudo[89461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:49 devstack sudo[89461]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 1G" returned: 0 in 0.478s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:49 devstack sudo[89466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 Apr 13 11:06:49 devstack sudo[89466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:49 devstack sudo[89466]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363" returned: 0 in 0.414s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:49 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 is being set with open permissions: ugo+rw Apr 13 11:06:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:49 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 Apr 13 11:06:49 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:49 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363" returned: 0 in 0.399s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:49 devstack sudo[89474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.info Apr 13 11:06:49 devstack sudo[89474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:50 devstack sudo[89474]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.info" returned: 0 in 0.408s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:50 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.info is being set with open permissions: ugo+rw Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:50 devstack sudo[89477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.info Apr 13 11:06:50 devstack sudo[89477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:50 devstack sudo[89477]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.info" returned: 0 in 0.395s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-9c64911a-d329-47dc-9647-9fd24ba81cda" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-9c64911a-d329-47dc-9647-9fd24ba81cda" acquired by "_copy_volume_from_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] snapshot: 8f4973b1-727d-4e81-b426-ca4338811363, volume: 9c64911a-d329-47dc-9647-9fd24ba81cda, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c6ef98-2b73-49ad-aff1-aa38c9a50c85]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:50 devstack sudo[89480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 Apr 13 11:06:50 devstack sudo[89480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:51 devstack sudo[89480]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363" returned: 0 in 0.456s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea89c4f8-0df4-48e5-89fd-76cc8af40693]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:51 devstack sudo[89485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b Apr 13 11:06:51 devstack sudo[89485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:51 devstack sudo[89485]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b" returned: 0 in 0.463s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:06:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:51 devstack sudo[89490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda Apr 13 11:06:51 devstack sudo[89490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:53 devstack sudo[89490]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda" returned: 0 in 1.841s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:53 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d4b3a5-945d-4eb9-b993-864280b0241e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:53 devstack sudo[89503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b Apr 13 11:06:53 devstack sudo[89503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:54 devstack sudo[89503]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b" returned: 0 in 0.573s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b, size 1024.00 MB, duration 1.84 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:06:54 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Converted 1024.00 MB image at 555.64 MB/s Apr 13 11:06:54 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda is being set with open permissions: ugo+rw Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:54 devstack sudo[89508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda Apr 13 11:06:54 devstack sudo[89508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:54 devstack sudo[89508]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda" returned: 0 in 0.403s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-9c64911a-d329-47dc-9647-9fd24ba81cda" released by "_copy_volume_from_snapshot" :: held 3.778s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-8f4973b1-727d-4e81-b426-ca4338811363" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-8f4973b1-727d-4e81-b426-ca4338811363" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Deleting offline snapshot 8f4973b1-727d-4e81-b426-ca4338811363 of volume 88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] snapshot_file for this snap is: volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[789dc098-8202-4b24-b2e1-eb103e066d61]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:54 devstack sudo[89511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 Apr 13 11:06:54 devstack sudo[89511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:54 devstack sudo[89511]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363" returned: 0 in 0.461s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c3d84c-8fa4-46b7-be0a-d2c5404e8098]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:55 devstack sudo[89516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b Apr 13 11:06:55 devstack sudo[89516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:55 devstack sudo[89516]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b" returned: 0 in 0.462s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:55 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 Apr 13 11:06:55 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:55 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363" returned: 0 in 0.424s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:55 devstack sudo[89526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363 Apr 13 11:06:55 devstack sudo[89526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:56 devstack sudo[89526]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b.8f4973b1-727d-4e81-b426-ca4338811363" returned: 0 in 0.397s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-8f4973b1-727d-4e81-b426-ca4338811363" released by "_delete_snapshot" :: held 1.787s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.237s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a95f85-3512-43a8-be70-d3bfd4d825cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c64911a-d329-47dc-9647-9fd24ba81cda', 'volume_size': 1, 'source_volid': '88a973d9-23b1-4043-8af0-ef1c396d3d9b', 'source_volstatus': 'available'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc0fb4b-2ad5-4ada-923f-cc8df89ff8a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:56 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Volume volume-9c64911a-d329-47dc-9647-9fd24ba81cda (9c64911a-d329-47dc-9647-9fd24ba81cda): created successfully Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7dc0fb4b-2ad5-4ada-923f-cc8df89ff8a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (9589684b-b726-42d0-b371-9fd4d8f8bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:56 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-64182ea8-fe03-4c3a-a070-cfc683e38280 tempest-VolumesGetTest-337536183 None] Created volume successfully. Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (826187e9-3c29-4216-b8ea-784b19e4b39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1098b3e-22cd-4f8d-a580-119ffa909024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1098b3e-22cd-4f8d-a580-119ffa909024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-575755967',display_name='tempest-VolumesGetTest-Volume-13443137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a571642-33e8-47b2-9fef-825907fd0944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:57Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41edbd8-0023-424d-aadc-be3a28c0edf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a41edbd8-0023-424d-aadc-be3a28c0edf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651de61b-4865-4854-b6e6-48a8cc31bedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (651de61b-4865-4854-b6e6-48a8cc31bedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a571642-33e8-47b2-9fef-825907fd0944', 'volume_name': 'volume-1a571642-33e8-47b2-9fef-825907fd0944', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9ec3ad-498c-440f-b6e9-14b2a89d3cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c9ec3ad-498c-440f-b6e9-14b2a89d3cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34cf876-127a-410a-8332-bea292ebec33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:56 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Volume 1a571642-33e8-47b2-9fef-825907fd0944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a571642-33e8-47b2-9fef-825907fd0944', 'volume_size': 1} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:06:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-575755967',display_name='tempest-VolumesGetTest-Volume-13443137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a571642-33e8-47b2-9fef-825907fd0944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:06:57Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Creating volume 1a571642-33e8-47b2-9fef-825907fd0944 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:06:56 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:06:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:56 devstack sudo[89529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 1073741824 Apr 13 11:06:56 devstack sudo[89529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:57 devstack sudo[89529]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 1073741824" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:57 devstack sudo[89534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 Apr 13 11:06:57 devstack sudo[89534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:57 devstack sudo[89534]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944" returned: 0 in 0.394s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d34cf876-127a-410a-8332-bea292ebec33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a571642-33e8-47b2-9fef-825907fd0944', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ee562a-3bf1-40e2-8749-f18b826b97fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:06:57 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Volume volume-1a571642-33e8-47b2-9fef-825907fd0944 (1a571642-33e8-47b2-9fef-825907fd0944): created successfully Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ee562a-3bf1-40e2-8749-f18b826b97fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:06:57 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (826187e9-3c29-4216-b8ea-784b19e4b39b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:06:57 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d4b83b52-660b-4a28-bdc2-98d101afec23 tempest-VolumesGetTest-337536183 None] Created volume successfully. Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-1a571642-33e8-47b2-9fef-825907fd0944-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Lock "cinder-1a571642-33e8-47b2-9fef-825907fd0944-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-1a571642-33e8-47b2-9fef-825907fd0944" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-1a571642-33e8-47b2-9fef-825907fd0944" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e0c026-e1e1-4898-9dce-a43eee071965]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:58 devstack sudo[89537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 Apr 13 11:06:58 devstack sudo[89537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:58 devstack sudo[89537]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:58 devstack sudo[89542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944 Apr 13 11:06:58 devstack sudo[89542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:58 devstack sudo[89542]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1a571642-33e8-47b2-9fef-825907fd0944" returned: 0 in 0.392s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-1a571642-33e8-47b2-9fef-825907fd0944" released by "delete_volume" :: held 0.868s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Created reservations ['a2ed3ef7-b80e-40cb-b2e6-61cf353be679', '2591a122-986d-48f9-a76d-32c12e327c99', 'd0cd4c2f-77f0-42f4-a25b-e78d875d9ee9', 'fe46bea6-d18e-4205-940e-ba42d5e43988'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:06:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:59 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:06:59 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-9c64911a-d329-47dc-9647-9fd24ba81cda-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Lock "cinder-9c64911a-d329-47dc-9647-9fd24ba81cda-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-9c64911a-d329-47dc-9647-9fd24ba81cda" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-9c64911a-d329-47dc-9647-9fd24ba81cda" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b2b679-ffb5-44c3-947a-0c63c5375809]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:59 devstack sudo[89547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda Apr 13 11:06:59 devstack sudo[89547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:06:59 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.440s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:06:59 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Deleted volume successfully. Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-855fdacb-56f8-4da5-b08a-1e884f0e41a8 tempest-VolumesGetTest-337536183 None] Lock "cinder-1a571642-33e8-47b2-9fef-825907fd0944-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:06:59 devstack sudo[89547]: pam_unix(sudo:session): session closed for user root Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda" returned: 0 in 0.478s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:06:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:06:59 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda Apr 13 11:06:59 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:00 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-9c64911a-d329-47dc-9647-9fd24ba81cda" returned: 0 in 0.393s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-9c64911a-d329-47dc-9647-9fd24ba81cda" released by "delete_volume" :: held 0.903s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Created reservations ['350b1f7f-5cda-414a-931b-3cb54eb51d3e', 'b7354142-a006-42f0-a398-62b8cae472d9', '632ac869-2c6e-42cb-b828-e94d44c00f05', '1ccafab0-1643-4f6a-a0b5-9e4e9baa32ce'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:00 devstack sudo[89556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:00 devstack sudo[89556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-88a973d9-23b1-4043-8af0-ef1c396d3d9b-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Lock "cinder-88a973d9-23b1-4043-8af0-ef1c396d3d9b-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-88a973d9-23b1-4043-8af0-ef1c396d3d9b" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-88a973d9-23b1-4043-8af0-ef1c396d3d9b" acquired by "delete_volume" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[246fad57-df14-4ecf-b701-696f04564f47]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:00 devstack sudo[89558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b Apr 13 11:07:00 devstack sudo[89558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:00 devstack sudo[89556]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.417s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:00 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Deleted volume successfully. Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a12b4261-0066-42e6-9921-cd1d8702ff9f tempest-VolumesGetTest-337536183 None] Lock "cinder-9c64911a-d329-47dc-9647-9fd24ba81cda-delete_volume" released by "delete_volume" :: held 1.454s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:00 devstack sudo[89558]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b" returned: 0 in 0.468s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:00 devstack sudo[89564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b Apr 13 11:07:00 devstack sudo[89564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:01 devstack sudo[89564]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-88a973d9-23b1-4043-8af0-ef1c396d3d9b" returned: 0 in 0.401s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-88a973d9-23b1-4043-8af0-ef1c396d3d9b" released by "delete_volume" :: held 0.906s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Created reservations ['600a3151-61e6-446a-80f4-6e2b51489d33', '76477f8f-d6af-443f-a9b8-83550b730108', 'f741b7ba-20b3-455e-aaeb-dc07299ad141', 'b5a19cdf-4880-4a39-8d0a-e97983309f54'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:01 devstack sudo[89567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:01 devstack sudo[89567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:01 devstack sudo[89567]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.420s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:01 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Deleted volume successfully. Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-8fc8e679-3902-450d-af3c-8f0785473f87 tempest-VolumesGetTest-337536183 None] Lock "cinder-88a973d9-23b1-4043-8af0-ef1c396d3d9b-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (6d5a7ca9-3eda-4733-b809-f1ca5a277c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9013735a-6cdd-4261-a53d-15b5f02750d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9013735a-6cdd-4261-a53d-15b5f02750d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1183808533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a805b864-8d41-457e-9f85-12701dcaa8bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:02Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a08dd4-6eea-47fa-a6ec-0ab1384d990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a08dd4-6eea-47fa-a6ec-0ab1384d990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cda5f07-5963-4f25-af5b-948ffcef11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:01 devstack cinder-volume[82656]: DEBUG cinder.image.glance [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Creating Keystone auth plugin from conf {{(pid=82656) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cda5f07-5963-4f25-af5b-948ffcef11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a805b864-8d41-457e-9f85-12701dcaa8bb', 'volume_name': 'volume-a805b864-8d41-457e-9f85-12701dcaa8bb', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215a8a9b-6de1-4e8d-bb52-b61e4f5d6e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (215a8a9b-6de1-4e8d-bb52-b61e4f5d6e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891bbd94-9a66-43d0-aa32-92b6d16387bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:02 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Volume a805b864-8d41-457e-9f85-12701dcaa8bb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a805b864-8d41-457e-9f85-12701dcaa8bb', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Trying to clone a805b864-8d41-457e-9f85-12701dcaa8bb from image 22e76a71-372d-4748-bc00-afb5725ee06e at location (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]). {{(pid=82656) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1089}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:732}} Apr 13 11:07:02 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Image download 20.69 MB at 20.69 MB/s Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c2da41-7b36-4f67-9215-892ec33aaff6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:02 devstack sudo[89572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD Apr 13 11:07:02 devstack sudo[89572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:02 devstack sudo[89572]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD" returned: 0 in 0.450s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Temporary image 22e76a71-372d-4748-bc00-afb5725ee06e is fetched for user 10899c1aab7f4082ba8bf937a148081c. {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:1431}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b15cc6d-4918-45ea-891b-3e01e4e00727]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:02 devstack sudo[89577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD Apr 13 11:07:02 devstack sudo[89577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:03 devstack sudo[89577]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD" returned: 0 in 0.488s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1183808533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a805b864-8d41-457e-9f85-12701dcaa8bb,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:02Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Creating volume a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:07:03 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:03 devstack sudo[89582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb 1073741824 Apr 13 11:07:03 devstack sudo[89582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:03 devstack sudo[89582]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb 1073741824" returned: 0 in 0.478s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:03 devstack sudo[89587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb Apr 13 11:07:03 devstack sudo[89587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:04 devstack sudo[89587]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb" returned: 0 in 0.404s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:07:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:04 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Attempting download of 22e76a71-372d-4748-bc00-afb5725ee06e ((None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}])) to volume a805b864-8d41-457e-9f85-12701dcaa8bb. {{(pid=82656) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1189}} Apr 13 11:07:04 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d130fc8-2b60-4c6f-b299-dad48f19e760]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_3iz8uh39 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:04 devstack sudo[89590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_3iz8uh39 Apr 13 11:07:04 devstack sudo[89590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:04 devstack sudo[89590]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_3iz8uh39" returned: 0 in 0.449s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_3iz8uh39 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:04 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_3iz8uh39 Apr 13 11:07:04 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:05 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_3iz8uh39" returned: 1 in 0.467s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_22e76a71-372d-4748-bc00-afb5725ee06e_3iz8uh39' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:07:05 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a929a5a3-fdca-4a17-baca-4da6f74a1da7]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:05 devstack sudo[89599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD Apr 13 11:07:05 devstack sudo[89599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:05 devstack sudo[89599]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD" returned: 0 in 0.443s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:05 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] 22e76a71-372d-4748-bc00-afb5725ee06e was qcow2, converting to raw {{(pid=82656) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1120}} Apr 13 11:07:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:05 devstack sudo[89604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb Apr 13 11:07:05 devstack sudo[89604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:06 devstack sudo[89604]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb" returned: 0 in 0.872s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:06 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_22e76a71-372d-4748-bc00-afb5725ee06e_k8midqt2devstack@QuobyteHD, size 112.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:07:06 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Converted 112.00 MB image at 112.00 MB/s Apr 13 11:07:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:06 devstack sudo[89620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb 1G Apr 13 11:07:06 devstack sudo[89620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:06 devstack sudo[89620]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb 1G" returned: 0 in 0.436s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:06 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd96e0a-e1ef-4235-add9-100e2008ecb0]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:07 devstack sudo[89625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb Apr 13 11:07:07 devstack sudo[89625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:07 devstack sudo[89625]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb" returned: 0 in 0.464s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:07 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb Apr 13 11:07:07 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:07 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb" returned: 1 in 0.460s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Downloaded image 22e76a71-372d-4748-bc00-afb5725ee06e ((None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}])) to volume a805b864-8d41-457e-9f85-12701dcaa8bb successfully. {{(pid=82656) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1234}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Temporary image 22e76a71-372d-4748-bc00-afb5725ee06e for user 10899c1aab7f4082ba8bf937a148081c is deleted. {{(pid=82656) fetch /opt/stack/cinder/cinder/image/image_utils.py:1435}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.volume.volume_utils [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Marking volume a805b864-8d41-457e-9f85-12701dcaa8bb as bootable. {{(pid=82656) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1138}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=167,cinder:DELETE=13,cinder:SELECT=124,cinder:INSERT=46 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Copying metadata from image 22e76a71-372d-4748-bc00-afb5725ee06e to a805b864-8d41-457e-9f85-12701dcaa8bb. {{(pid=82656) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Creating volume glance metadata for volume a805b864-8d41-457e-9f85-12701dcaa8bb backed by image 22e76a71-372d-4748-bc00-afb5725ee06e with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=82656) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=110,cinder:INSERT=33,cinder:UPDATE=149,cinder:DELETE=13 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891bbd94-9a66-43d0-aa32-92b6d16387bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a805b864-8d41-457e-9f85-12701dcaa8bb', 'volume_size': 1, 'image_id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/22e76a71-372d-4748-bc00-afb5725ee06e', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '83f6b9c31def433d931e0447ce75a5d2', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '22e76a71-372d-4748-bc00-afb5725ee06e', 'created_at': datetime.datetime(2026, 4, 13, 8, 54, 23, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 4, 13, 8, 54, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/22e76a71-372d-4748-bc00-afb5725ee06e/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6939b33e-800d-4844-b591-e2fccb8bbb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:07 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Volume volume-a805b864-8d41-457e-9f85-12701dcaa8bb (a805b864-8d41-457e-9f85-12701dcaa8bb): created successfully Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6939b33e-800d-4844-b591-e2fccb8bbb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (6d5a7ca9-3eda-4733-b809-f1ca5a277c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:07 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-8946fb70-3243-451b-ae21-f16346eaf55f tempest-VolumesGetTest-337536183 None] Created volume successfully. Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (98263afb-6f83-4777-b971-c7d4fc2a325e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3c31a0-f7a9-4adf-9880-e65db1229125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a3c31a0-f7a9-4adf-9880-e65db1229125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-647862450',display_name='tempest-VolumesGetTest-Volume-750531407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9fd775-c911-45e0-8598-92610047b364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:09Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eaba0f0-079e-4b0f-a8ed-b4f887daaf46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eaba0f0-079e-4b0f-a8ed-b4f887daaf46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5205a4a2-20be-4cf5-8e1a-a372dd5af2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5205a4a2-20be-4cf5-8e1a-a372dd5af2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc9fd775-c911-45e0-8598-92610047b364', 'volume_name': 'volume-bc9fd775-c911-45e0-8598-92610047b364', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6f427a-e736-4109-b9cd-8eccc9713b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e6f427a-e736-4109-b9cd-8eccc9713b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5a50ba-c549-4e6f-ba92-1ef578f6873b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:08 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Volume bc9fd775-c911-45e0-8598-92610047b364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc9fd775-c911-45e0-8598-92610047b364', 'volume_size': 1} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-647862450',display_name='tempest-VolumesGetTest-Volume-750531407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc9fd775-c911-45e0-8598-92610047b364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87d86e06c01147f4ab9dfddccad275f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:09Z,use_quota=True,user_id='10899c1aab7f4082ba8bf937a148081c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Creating volume bc9fd775-c911-45e0-8598-92610047b364 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:07:08 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:07:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:08 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 1073741824 Apr 13 11:07:08 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:09 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 1073741824" returned: 0 in 0.469s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:09 devstack sudo[89639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 Apr 13 11:07:09 devstack sudo[89639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:09 devstack sudo[89639]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364" returned: 0 in 0.400s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5a50ba-c549-4e6f-ba92-1ef578f6873b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc9fd775-c911-45e0-8598-92610047b364', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e5a12a-4441-477d-981b-5bdab78fe8e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:09 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Volume volume-bc9fd775-c911-45e0-8598-92610047b364 (bc9fd775-c911-45e0-8598-92610047b364): created successfully Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7e5a12a-4441-477d-981b-5bdab78fe8e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Flow 'volume_create_manager' (98263afb-6f83-4777-b971-c7d4fc2a325e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:09 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-12f71bc8-0f2e-4666-a91b-f94a814a0692 tempest-VolumesGetTest-337536183 None] Created volume successfully. Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-bc9fd775-c911-45e0-8598-92610047b364-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Lock "cinder-bc9fd775-c911-45e0-8598-92610047b364-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-bc9fd775-c911-45e0-8598-92610047b364" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-bc9fd775-c911-45e0-8598-92610047b364" acquired by "delete_volume" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8439ed-e2ea-4c19-b9dd-7bd2d1de72c6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:09 devstack sudo[89642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 Apr 13 11:07:09 devstack sudo[89642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:10 devstack sudo[89642]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364" returned: 0 in 0.487s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:10 devstack sudo[89647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364 Apr 13 11:07:10 devstack sudo[89647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:10 devstack sudo[89647]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bc9fd775-c911-45e0-8598-92610047b364" returned: 0 in 0.399s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-bc9fd775-c911-45e0-8598-92610047b364" released by "delete_volume" :: held 0.917s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Created reservations ['9bd4bf86-7964-4b62-86e1-6e94a55bd9c5', 'a1aa93a9-5ad5-4f0a-bd6d-d7b3a6af2f58', '1e85893e-dd93-437b-9abf-9283f202d614', '97407ec9-f680-49c6-91f9-3e0cf9e3c25d'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:10 devstack sudo[89650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:10 devstack sudo[89650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-a805b864-8d41-457e-9f85-12701dcaa8bb-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Lock "cinder-a805b864-8d41-457e-9f85-12701dcaa8bb-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Acquiring lock "cinder-quobyte-a805b864-8d41-457e-9f85-12701dcaa8bb" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-a805b864-8d41-457e-9f85-12701dcaa8bb" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[65210022-07ae-400d-a30f-786bd5ed9cff]: (4, 'raw') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:11 devstack sudo[89653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb Apr 13 11:07:11 devstack sudo[89653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:11 devstack sudo[89650]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.412s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Deleted volume successfully. Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-604c2572-5140-4b8f-bd58-89d67210ece3 tempest-VolumesGetTest-337536183 None] Lock "cinder-bc9fd775-c911-45e0-8598-92610047b364-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:11 devstack sudo[89653]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb" returned: 0 in 0.460s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:11 devstack sudo[89657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb Apr 13 11:07:11 devstack sudo[89657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:12 devstack sudo[89657]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb" returned: 1 in 0.455s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb' failed. Not Retrying. {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:543}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:12 devstack sudo[89663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb Apr 13 11:07:12 devstack sudo[89663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:12 devstack sudo[89663]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a805b864-8d41-457e-9f85-12701dcaa8bb" returned: 0 in 0.407s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Lock "cinder-quobyte-a805b864-8d41-457e-9f85-12701dcaa8bb" released by "delete_volume" :: held 1.360s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Created reservations ['fdb11d6b-531f-45a3-a381-1e287d4defd8', 'f2b2f695-748c-435e-a04a-6483d75620ee', '34f8f8a2-35c0-490a-9273-125af024b796', '2848f837-e3ef-40e7-8421-4b68759d8633'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:12 devstack sudo[89666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:12 devstack sudo[89666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:12 devstack sudo[89666]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.404s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:12 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Deleted volume successfully. Apr 13 11:07:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-41ce7085-72a3-4324-a2f1-c70e23b94cdd tempest-VolumesGetTest-337536183 None] Lock "cinder-a805b864-8d41-457e-9f85-12701dcaa8bb-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Flow 'volume_create_manager' (b7010fc0-a9c4-45f6-8bd6-8c303c74c200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b4592d-46db-41b5-8a68-222f7139b9d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57b4592d-46db-41b5-8a68-222f7139b9d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1776663013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8e4a38-3e89-4922-b3ba-f1f038a3bae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f72001896746198a3ce21f9b0e243e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:15Z,use_quota=True,user_id='f0b92c6dc83f4c349bd18753ab97f315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0461b76f-8d2c-4936-88d3-41602ef8c75e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0461b76f-8d2c-4936-88d3-41602ef8c75e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae3d3b2-bae9-48c0-a543-310d08bda872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ae3d3b2-bae9-48c0-a543-310d08bda872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8e4a38-3e89-4922-b3ba-f1f038a3bae5', 'volume_name': 'volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5', 'volume_size': 2}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c069f686-6fb1-41f5-b27c-4ce515b65e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c069f686-6fb1-41f5-b27c-4ce515b65e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0496446-67c7-4bee-ad23-3d558405635f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:14 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Volume 0f8e4a38-3e89-4922-b3ba-f1f038a3bae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5', 'volume_size': 2} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1776663013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8e4a38-3e89-4922-b3ba-f1f038a3bae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4f72001896746198a3ce21f9b0e243e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:15Z,use_quota=True,user_id='f0b92c6dc83f4c349bd18753ab97f315',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Creating volume 0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:07:14 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:07:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 2147483648 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:14 devstack sudo[89669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 2147483648 Apr 13 11:07:14 devstack sudo[89669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:15 devstack sudo[89669]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 2147483648" returned: 0 in 0.510s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:15 devstack sudo[89674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 Apr 13 11:07:15 devstack sudo[89674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:15 devstack sudo[89674]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" returned: 0 in 0.399s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0496446-67c7-4bee-ad23-3d558405635f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5', 'volume_size': 2}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7816bd09-949b-4c5e-af62-36c6dce0d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:15 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Volume volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 (0f8e4a38-3e89-4922-b3ba-f1f038a3bae5): created successfully Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7816bd09-949b-4c5e-af62-36c6dce0d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:15 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Flow 'volume_create_manager' (b7010fc0-a9c4-45f6-8bd6-8c303c74c200) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:15 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1bc1cb4e-d1c1-43c2-a370-85c53c8ec836 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Created volume successfully. Apr 13 11:07:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Creating offline snapshot 8a0c78ab-a821-4502-b2c0-3b8492df4e1a of volume 0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:07:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fde6e87-4145-40ea-80d0-b233024a85c8]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:17 devstack sudo[89677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 Apr 13 11:07:17 devstack sudo[89677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:17 devstack sudo[89677]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" returned: 0 in 0.459s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a 2G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:17 devstack sudo[89682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a 2G Apr 13 11:07:17 devstack sudo[89682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:18 devstack sudo[89682]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a 2G" returned: 0 in 0.460s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:18 devstack sudo[89687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a Apr 13 11:07:18 devstack sudo[89687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:18 devstack sudo[89687]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a" returned: 0 in 0.420s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:18 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a is being set with open permissions: ugo+rw Apr 13 11:07:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:18 devstack sudo[89692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a Apr 13 11:07:18 devstack sudo[89692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:18 devstack sudo[89692]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a" returned: 0 in 0.394s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:18 devstack sudo[89696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.info Apr 13 11:07:18 devstack sudo[89696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:19 devstack sudo[89696]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.info" returned: 0 in 0.401s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:19 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.info is being set with open permissions: ugo+rw Apr 13 11:07:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:19 devstack sudo[89699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.info Apr 13 11:07:19 devstack sudo[89699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:19 devstack sudo[89699]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.info" returned: 0 in 0.393s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.617s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:19 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-66742b21-9f29-45e7-9186-ba8e4a9311f9 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Create snapshot completed successfully Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "cinder-8a0c78ab-a821-4502-b2c0-3b8492df4e1a-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-8a0c78ab-a821-4502-b2c0-3b8492df4e1a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "cinder-quobyte-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-quobyte-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "cinder-quobyte-8a0c78ab-a821-4502-b2c0-3b8492df4e1a" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-quobyte-8a0c78ab-a821-4502-b2c0-3b8492df4e1a" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Deleting offline snapshot 8a0c78ab-a821-4502-b2c0-3b8492df4e1a of volume 0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] snapshot_file for this snap is: volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2d4f1c2-a750-437e-9df1-f60e475f2bd6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:20 devstack sudo[89702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a Apr 13 11:07:20 devstack sudo[89702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:20 devstack sudo[89702]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a" returned: 0 in 0.469s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ede523-f927-4e0a-a9d9-b407bdb03b30]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:20 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 Apr 13 11:07:20 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:21 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" returned: 0 in 0.459s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:21 devstack sudo[89715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a Apr 13 11:07:21 devstack sudo[89715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:21 devstack sudo[89715]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a" returned: 0 in 0.432s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:21 devstack sudo[89723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a Apr 13 11:07:21 devstack sudo[89723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:22 devstack sudo[89723]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5.8a0c78ab-a821-4502-b2c0-3b8492df4e1a" returned: 0 in 0.396s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-quobyte-8a0c78ab-a821-4502-b2c0-3b8492df4e1a" released by "_delete_snapshot" :: held 1.815s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-quobyte-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" released by "delete_snapshot" :: held 1.828s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Created reservations ['6872ae6e-6106-4706-b5cc-f2a3b6483336', 'f366bfcf-b0fb-4c21-94f7-36204b4274b3', 'd2749cda-7c39-49dd-8c72-098f2eee9ca9', 'afb64340-550a-44df-b614-1fc72a733a65'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:22 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Delete snapshot completed successfully. Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e73ac79c-3b43-44bb-9124-35bd2803511e tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-8a0c78ab-a821-4502-b2c0-3b8492df4e1a-delete_snapshot" released by "delete_snapshot" :: held 1.905s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "cinder-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "cinder-quobyte-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-quobyte-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[94184d08-c168-4656-bded-a7af70309b8b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:22 devstack sudo[89727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 Apr 13 11:07:22 devstack sudo[89727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:22 devstack sudo[89727]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:22 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5 Apr 13 11:07:22 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:23 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" returned: 0 in 0.412s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-quobyte-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5" released by "delete_volume" :: held 0.897s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Created reservations ['1fb4c92c-64a5-4481-b258-9c5ee3ed2ff7', '3938ccdc-cdb1-4502-8dc3-1375b72c29e5', '562b1143-d194-4214-be2e-a1f009a33896', '49384214-1415-4dd5-bd52-444a25451a75'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:23 devstack sudo[89735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:23 devstack sudo[89735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:23 devstack sudo[89735]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.434s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Deleted volume successfully. Apr 13 11:07:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7600b2f7-62c2-4816-8da2-88e0919ba464 tempest-VolumesSnapshotNegativeTestJSON-1555805750 None] Lock "cinder-0f8e4a38-3e89-4922-b3ba-f1f038a3bae5-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Flow 'volume_create_manager' (352fb222-80b9-4096-93a7-89e6acfbdffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442ea1cf-8a1a-4c1f-80b6-a7baa203789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (442ea1cf-8a1a-4c1f-80b6-a7baa203789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-168168405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53aad9b-dcbc-4822-a861-2bcffe0b4039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb3a732aa94354b16d1f4d0e65ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:25Z,use_quota=True,user_id='0e329e40843d4dfd9fc7fe8596d05f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3422df-404e-43e5-8260-530587b4abb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3422df-404e-43e5-8260-530587b4abb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44db218f-e212-45a7-8e34-d94ed4892e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44db218f-e212-45a7-8e34-d94ed4892e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a53aad9b-dcbc-4822-a861-2bcffe0b4039', 'volume_name': 'volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e1cfa8-7bbd-4f07-b438-832f82b3d0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22e1cfa8-7bbd-4f07-b438-832f82b3d0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a3d287-323d-4fdb-a2b1-1886f4bdc2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:25 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Volume a53aad9b-dcbc-4822-a861-2bcffe0b4039: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039', 'volume_size': 1} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-168168405',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53aad9b-dcbc-4822-a861-2bcffe0b4039,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb3a732aa94354b16d1f4d0e65ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:25Z,use_quota=True,user_id='0e329e40843d4dfd9fc7fe8596d05f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Creating volume a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:07:25 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:25 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 1073741824 Apr 13 11:07:25 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:25 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 1073741824" returned: 0 in 0.468s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:25 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 Apr 13 11:07:25 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:26 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039" returned: 0 in 0.406s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7a3d287-323d-4fdb-a2b1-1886f4bdc2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2915ab-9b75-4578-b28b-e89042f8bfe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:26 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Volume volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 (a53aad9b-dcbc-4822-a861-2bcffe0b4039): created successfully Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c2915ab-9b75-4578-b28b-e89042f8bfe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Flow 'volume_create_manager' (352fb222-80b9-4096-93a7-89e6acfbdffd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:26 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-703afd06-4e23-44dc-b254-bfdf16728eb6 tempest-VolumeDependencyTests-1639924013 None] Created volume successfully. Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Creating offline snapshot d164e194-1e5c-4c67-9209-657a3c5fe9bc of volume a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab300522-3712-48f9-b8af-3fc9743214b2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:26 devstack sudo[89747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 Apr 13 11:07:26 devstack sudo[89747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:26 devstack sudo[89747]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039" returned: 0 in 0.472s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:26 devstack sudo[89752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc 1G Apr 13 11:07:26 devstack sudo[89752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:27 devstack sudo[89752]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc 1G" returned: 0 in 0.469s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:27 devstack sudo[89757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc Apr 13 11:07:27 devstack sudo[89757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:27 devstack sudo[89757]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc" returned: 0 in 0.433s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:27 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc is being set with open permissions: ugo+rw Apr 13 11:07:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:27 devstack sudo[89762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc Apr 13 11:07:27 devstack sudo[89762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:28 devstack sudo[89762]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc" returned: 0 in 0.411s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:28 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.info Apr 13 11:07:28 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:28 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.info" returned: 0 in 0.424s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:28 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.info is being set with open permissions: ugo+rw Apr 13 11:07:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:28 devstack sudo[89768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.info Apr 13 11:07:28 devstack sudo[89768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:28 devstack sudo[89768]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.info" returned: 0 in 0.416s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:28 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.681s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:28 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1d170c9a-3345-48d7-be55-f21253bb7e0f tempest-VolumeDependencyTests-1639924013 None] Create snapshot completed successfully Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Flow 'volume_create_manager' (370c866b-d28a-4af8-953c-6df82118750f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7439416-db3b-4e22-97a9-8133b7f234e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7439416-db3b-4e22-97a9-8133b7f234e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1179420527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff8aa01-3fe7-484b-ad54-f2a93f0857d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb3a732aa94354b16d1f4d0e65ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d164e194-1e5c-4c67-9209-657a3c5fe9bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:30Z,use_quota=True,user_id='0e329e40843d4dfd9fc7fe8596d05f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3f9aa4-7241-435b-9c65-b1cd562d2400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3f9aa4-7241-435b-9c65-b1cd562d2400) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489b3e51-f23e-47e8-a976-3fc656f58dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489b3e51-f23e-47e8-a976-3fc656f58dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1ff8aa01-3fe7-484b-ad54-f2a93f0857d7', 'volume_name': 'volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7', 'volume_size': 1, 'snapshot_id': 'd164e194-1e5c-4c67-9209-657a3c5fe9bc'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5439f15c-2868-4015-978b-d8a3021faa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5439f15c-2868-4015-978b-d8a3021faa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90bccf9-4b27-4e06-ba6b-77b501f74d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:29 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Volume 1ff8aa01-3fe7-484b-ad54-f2a93f0857d7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7', 'volume_size': 1, 'snapshot_id': 'd164e194-1e5c-4c67-9209-657a3c5fe9bc'} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-d164e194-1e5c-4c67-9209-657a3c5fe9bc-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" by "_create_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-d164e194-1e5c-4c67-9209-657a3c5fe9bc-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Creating volume 1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 from snapshot d164e194-1e5c-4c67-9209-657a3c5fe9bc {{(pid=82656) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] snapshot: d164e194-1e5c-4c67-9209-657a3c5fe9bc, volume: 1ff8aa01-3fe7-484b-ad54-f2a93f0857d7, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[786579aa-457e-4509-a0e4-f760682a6964]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:29 devstack sudo[89771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc Apr 13 11:07:29 devstack sudo[89771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:30 devstack sudo[89771]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2908e3-51e8-436c-855c-997d413bfda5]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:30 devstack sudo[89776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 Apr 13 11:07:30 devstack sudo[89776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:30 devstack sudo[89776]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039" returned: 0 in 0.479s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:07:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:30 devstack sudo[89781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 Apr 13 11:07:30 devstack sudo[89781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:32 devstack sudo[89781]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" returned: 0 in 1.846s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:32 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b89200e-23e4-4ad7-802c-f8808b3fb498]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:32 devstack sudo[89794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 Apr 13 11:07:32 devstack sudo[89794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:33 devstack sudo[89794]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039" returned: 0 in 0.608s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039, size 1024.00 MB, duration 1.85 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:07:33 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Converted 1024.00 MB image at 554.33 MB/s Apr 13 11:07:33 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 is being set with open permissions: ugo+rw Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:33 devstack sudo[89799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 Apr 13 11:07:33 devstack sudo[89799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:33 devstack sudo[89799]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" returned: 0 in 0.398s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" released by "_copy_volume_from_snapshot" :: held 3.852s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-d164e194-1e5c-4c67-9209-657a3c5fe9bc-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" released by "_create_volume_from_snapshot" :: held 3.868s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.876s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e90bccf9-4b27-4e06-ba6b-77b501f74d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7', 'volume_size': 1, 'snapshot_id': 'd164e194-1e5c-4c67-9209-657a3c5fe9bc'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07da4ef-b33e-415f-9746-83d0871e0627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:33 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Volume volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 (1ff8aa01-3fe7-484b-ad54-f2a93f0857d7): created successfully Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e07da4ef-b33e-415f-9746-83d0871e0627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Flow 'volume_create_manager' (370c866b-d28a-4af8-953c-6df82118750f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:33 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f01c34f0-9aad-4506-bd28-04bce2d82474 tempest-VolumeDependencyTests-1639924013 None] Created volume successfully. Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-d164e194-1e5c-4c67-9209-657a3c5fe9bc-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-d164e194-1e5c-4c67-9209-657a3c5fe9bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-a53aad9b-dcbc-4822-a861-2bcffe0b4039" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-a53aad9b-dcbc-4822-a861-2bcffe0b4039" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-d164e194-1e5c-4c67-9209-657a3c5fe9bc" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-d164e194-1e5c-4c67-9209-657a3c5fe9bc" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Deleting offline snapshot d164e194-1e5c-4c67-9209-657a3c5fe9bc of volume a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] snapshot_file for this snap is: volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0244df-f5c3-4872-a9a7-9abd6f8f02b0]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:34 devstack sudo[89802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc Apr 13 11:07:34 devstack sudo[89802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:34 devstack sudo[89802]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc" returned: 0 in 0.464s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f84794-674d-4e3f-9f14-27975dc23007]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:34 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 Apr 13 11:07:34 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:35 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039" returned: 0 in 0.474s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:35 devstack sudo[89812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc Apr 13 11:07:35 devstack sudo[89812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:35 devstack sudo[89812]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc" returned: 0 in 0.479s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:35 devstack sudo[89817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc Apr 13 11:07:35 devstack sudo[89817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:35 devstack sudo[89817]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039.d164e194-1e5c-4c67-9209-657a3c5fe9bc" returned: 0 in 0.395s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-d164e194-1e5c-4c67-9209-657a3c5fe9bc" released by "_delete_snapshot" :: held 1.868s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-a53aad9b-dcbc-4822-a861-2bcffe0b4039" released by "delete_snapshot" :: held 1.881s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:35 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Created reservations ['8a24ec9e-308e-4117-8b45-2e998574dacd', 'a9878d77-0b98-46ba-8124-b121eea0633b', '3e95bd28-9e08-436d-a88c-21ff99f4a3e1', 'c83242b7-df37-46a8-8b02-1dbad121d59b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Delete snapshot completed successfully. Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-634ebe45-e7d5-488b-a3a5-bc10aef02056 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-d164e194-1e5c-4c67-9209-657a3c5fe9bc-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-a53aad9b-dcbc-4822-a861-2bcffe0b4039-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-a53aad9b-dcbc-4822-a861-2bcffe0b4039-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-a53aad9b-dcbc-4822-a861-2bcffe0b4039" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-a53aad9b-dcbc-4822-a861-2bcffe0b4039" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[151b1913-89d5-44be-95a4-94d4a32f1e15]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:36 devstack sudo[89820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 Apr 13 11:07:36 devstack sudo[89820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:36 devstack sudo[89820]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039" returned: 0 in 0.463s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:36 devstack sudo[89825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039 Apr 13 11:07:36 devstack sudo[89825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:37 devstack sudo[89825]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a53aad9b-dcbc-4822-a861-2bcffe0b4039" returned: 0 in 0.411s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-a53aad9b-dcbc-4822-a861-2bcffe0b4039" released by "delete_volume" :: held 0.912s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Created reservations ['0f002d76-b889-4f9b-b2c2-69ab8827f47a', '0fb53c77-769d-4ba4-b3e7-b7c7ed2a14ce', '439e3425-cb97-407e-83e9-106ab30463bd', '04b34423-e792-4a8c-809c-fc0f58a2f594'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:37 devstack sudo[89828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:37 devstack sudo[89828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Flow 'volume_create_manager' (57c1a850-e997-473e-ba89-000301ec2f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b68d17-b009-4bdf-85c5-af0c1cd79207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2b68d17-b009-4bdf-85c5-af0c1cd79207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1650302012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2871338-6c0a-4050-b879-493e08820561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb3a732aa94354b16d1f4d0e65ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:37Z,use_quota=True,user_id='0e329e40843d4dfd9fc7fe8596d05f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f453bbce-34e2-4340-a6d5-4ce7fef75344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f453bbce-34e2-4340-a6d5-4ce7fef75344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa273fd1-20dc-4651-8387-dce65747a0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa273fd1-20dc-4651-8387-dce65747a0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2871338-6c0a-4050-b879-493e08820561', 'volume_name': 'volume-e2871338-6c0a-4050-b879-493e08820561', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61faec06-b5e6-4be1-996e-649650240f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61faec06-b5e6-4be1-996e-649650240f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ccd286-12c8-4e5b-8d37-7abb2fdd33c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:37 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Volume e2871338-6c0a-4050-b879-493e08820561: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2871338-6c0a-4050-b879-493e08820561', 'volume_size': 1} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1650302012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2871338-6c0a-4050-b879-493e08820561,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb3a732aa94354b16d1f4d0e65ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:37Z,use_quota=True,user_id='0e329e40843d4dfd9fc7fe8596d05f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Creating volume e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:07:37 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:37 devstack sudo[89831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 1073741824 Apr 13 11:07:37 devstack sudo[89831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:37 devstack sudo[89828]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.479s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:37 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Deleted volume successfully. Apr 13 11:07:37 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-064a604e-ef48-41f8-9ecd-f518a6264ee4 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-a53aad9b-dcbc-4822-a861-2bcffe0b4039-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:38 devstack sudo[89831]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 1073741824" returned: 0 in 0.491s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:38 devstack sudo[89836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 Apr 13 11:07:38 devstack sudo[89836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:38 devstack sudo[89836]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561" returned: 0 in 0.416s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3ccd286-12c8-4e5b-8d37-7abb2fdd33c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2871338-6c0a-4050-b879-493e08820561', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2c46f3-4b27-4b85-9cd8-1e75365ad729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Volume volume-e2871338-6c0a-4050-b879-493e08820561 (e2871338-6c0a-4050-b879-493e08820561): created successfully Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f2c46f3-4b27-4b85-9cd8-1e75365ad729) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Flow 'volume_create_manager' (57c1a850-e997-473e-ba89-000301ec2f15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:38 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2eeaf217-11c8-4802-877c-639480d94aa5 tempest-VolumeDependencyTests-1639924013 None] Created volume successfully. Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:38 devstack sudo[89839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:38 devstack sudo[89839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:39 devstack sudo[89839]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.394s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Flow 'volume_create_manager' (168668bf-b9c6-4c5f-9e8e-f470727cfc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5569792-a9a7-4d34-9ca2-390e024f4ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5569792-a9a7-4d34-9ca2-390e024f4ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:07:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-466131256',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57aab90d-a9aa-4670-9299-fa767fee16a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='77eb3a732aa94354b16d1f4d0e65ad11',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=e2871338-6c0a-4050-b879-493e08820561,status='creating',terminated_at=None,updated_at=2026-04-13T09:07:40Z,use_quota=True,user_id='0e329e40843d4dfd9fc7fe8596d05f51',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01153f4-9ee8-4764-be04-b55652ec6947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d01153f4-9ee8-4764-be04-b55652ec6947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e420a31-7a9e-4a9b-b9c2-07078d4b18aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e420a31-7a9e-4a9b-b9c2-07078d4b18aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '57aab90d-a9aa-4670-9299-fa767fee16a5', 'volume_name': 'volume-57aab90d-a9aa-4670-9299-fa767fee16a5', 'volume_size': 1, 'source_volid': 'e2871338-6c0a-4050-b879-493e08820561', 'source_volstatus': 'available'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00c4317-1935-49da-801b-13f4408b332b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e00c4317-1935-49da-801b-13f4408b332b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af45626-781a-4b5b-bb94-f6293ee9ece4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:39 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Volume 57aab90d-a9aa-4670-9299-fa767fee16a5: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-57aab90d-a9aa-4670-9299-fa767fee16a5', 'volume_size': 1, 'source_volid': 'e2871338-6c0a-4050-b879-493e08820561', 'source_volstatus': 'available'} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:39 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Cloning volume e2871338-6c0a-4050-b879-493e08820561 to volume 57aab90d-a9aa-4670-9299-fa767fee16a5 Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Creating offline snapshot e4852664-e173-40ee-a51f-97dfc98d17de of volume e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[85eda1ed-2dc7-44eb-b793-30f26dd549a2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:40 devstack sudo[89876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 Apr 13 11:07:40 devstack sudo[89876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:40 devstack sudo[89876]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561" returned: 0 in 0.469s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:40 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de 1G Apr 13 11:07:40 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:40 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de 1G" returned: 0 in 0.504s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2871338-6c0a-4050-b879-493e08820561 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:40 devstack sudo[89886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2871338-6c0a-4050-b879-493e08820561 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de Apr 13 11:07:40 devstack sudo[89886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:41 devstack sudo[89886]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e2871338-6c0a-4050-b879-493e08820561 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de" returned: 0 in 0.417s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:41 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de is being set with open permissions: ugo+rw Apr 13 11:07:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:41 devstack sudo[89891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de Apr 13 11:07:41 devstack sudo[89891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:41 devstack sudo[89891]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de" returned: 0 in 0.401s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:41 devstack sudo[89897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.info Apr 13 11:07:41 devstack sudo[89897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:42 devstack sudo[89897]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.info" returned: 0 in 0.406s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:42 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.info is being set with open permissions: ugo+rw Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:42 devstack sudo[89900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.info Apr 13 11:07:42 devstack sudo[89900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:42 devstack sudo[89900]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.info" returned: 0 in 0.403s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-57aab90d-a9aa-4670-9299-fa767fee16a5" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-57aab90d-a9aa-4670-9299-fa767fee16a5" acquired by "_copy_volume_from_snapshot" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] snapshot: e4852664-e173-40ee-a51f-97dfc98d17de, volume: 57aab90d-a9aa-4670-9299-fa767fee16a5, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2c1634-897a-458b-9d2f-9901fee2aa03]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:42 devstack sudo[89903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de Apr 13 11:07:42 devstack sudo[89903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:43 devstack sudo[89903]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de" returned: 0 in 0.461s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2871338-6c0a-4050-b879-493e08820561(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c47a7-7250-401c-b2c9-0f9daa72d7ae]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:43 devstack sudo[89908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 Apr 13 11:07:43 devstack sudo[89908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:43 devstack sudo[89908]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561" returned: 0 in 0.456s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:07:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:43 devstack sudo[89913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 Apr 13 11:07:43 devstack sudo[89913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:45 devstack sudo[89913]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5" returned: 0 in 1.808s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:45 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[060e7047-7913-48ac-9380-4b7b08c092e7]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:45 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 Apr 13 11:07:45 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:45 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561" returned: 0 in 0.575s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:45 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561, size 1024.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:07:45 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Converted 1024.00 MB image at 566.14 MB/s Apr 13 11:07:45 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 is being set with open permissions: ugo+rw Apr 13 11:07:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:45 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 Apr 13 11:07:45 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:46 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5" returned: 0 in 0.415s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-57aab90d-a9aa-4670-9299-fa767fee16a5" released by "_copy_volume_from_snapshot" :: held 3.758s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-e4852664-e173-40ee-a51f-97dfc98d17de" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-e4852664-e173-40ee-a51f-97dfc98d17de" acquired by "_delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Deleting offline snapshot e4852664-e173-40ee-a51f-97dfc98d17de of volume e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] snapshot_file for this snap is: volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[39613bfb-e7df-489e-9098-3655c6b74e27]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:46 devstack sudo[89933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de Apr 13 11:07:46 devstack sudo[89933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:46 devstack sudo[89933]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de" returned: 0 in 0.459s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e2871338-6c0a-4050-b879-493e08820561(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5420eab-3c87-4e51-a039-d6db599848f6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:46 devstack sudo[89938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 Apr 13 11:07:46 devstack sudo[89938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:47 devstack sudo[89938]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:47 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de Apr 13 11:07:47 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:47 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de" returned: 0 in 0.442s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:47 devstack sudo[89948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de Apr 13 11:07:47 devstack sudo[89948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:48 devstack sudo[89948]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561.e4852664-e173-40ee-a51f-97dfc98d17de" returned: 0 in 0.401s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:48 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-e4852664-e173-40ee-a51f-97dfc98d17de" released by "_delete_snapshot" :: held 1.821s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 8.292s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af45626-781a-4b5b-bb94-f6293ee9ece4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57aab90d-a9aa-4670-9299-fa767fee16a5', 'volume_size': 1, 'source_volid': 'e2871338-6c0a-4050-b879-493e08820561', 'source_volstatus': 'available'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fef44f-922c-43f0-b787-c1b67efbaa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:07:48 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Volume volume-57aab90d-a9aa-4670-9299-fa767fee16a5 (57aab90d-a9aa-4670-9299-fa767fee16a5): created successfully Apr 13 11:07:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8fef44f-922c-43f0-b787-c1b67efbaa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:07:48 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Flow 'volume_create_manager' (168668bf-b9c6-4c5f-9e8e-f470727cfc1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:07:48 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b9f63fff-0b28-47b0-9791-5b1249999a2e tempest-VolumeDependencyTests-1639924013 None] Created volume successfully. Apr 13 11:07:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-e2871338-6c0a-4050-b879-493e08820561-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-e2871338-6c0a-4050-b879-493e08820561-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-e2871338-6c0a-4050-b879-493e08820561" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:49 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-e2871338-6c0a-4050-b879-493e08820561" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:49 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfeabbc-232f-458c-921c-bf6958076dc7]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:49 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 Apr 13 11:07:49 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:49 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:49 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561 Apr 13 11:07:49 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:50 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-e2871338-6c0a-4050-b879-493e08820561" returned: 0 in 0.396s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-e2871338-6c0a-4050-b879-493e08820561" released by "delete_volume" :: held 0.876s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Created reservations ['63d9b58f-fdca-45dd-a14c-38660fdd8eec', '87630baf-15cb-4848-af6f-dabee890877e', 'de5c437f-3758-43ab-b0eb-f61277d46487', '43c233bf-7b99-44fc-a4ad-2bf9db162c6f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:50 devstack sudo[89959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:50 devstack sudo[89959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-57aab90d-a9aa-4670-9299-fa767fee16a5-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-57aab90d-a9aa-4670-9299-fa767fee16a5-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-57aab90d-a9aa-4670-9299-fa767fee16a5" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-57aab90d-a9aa-4670-9299-fa767fee16a5" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5091f262-f925-4e11-9d25-866cdd57a6ba]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:50 devstack sudo[89961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 Apr 13 11:07:50 devstack sudo[89961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:50 devstack sudo[89959]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.421s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:50 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Deleted volume successfully. Apr 13 11:07:50 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f7bc6550-1a69-4f6e-b768-c2e390985c3a tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-e2871338-6c0a-4050-b879-493e08820561-delete_volume" released by "delete_volume" :: held 1.420s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:51 devstack sudo[89961]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5" returned: 0 in 0.476s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:51 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5 Apr 13 11:07:51 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:51 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57aab90d-a9aa-4670-9299-fa767fee16a5" returned: 0 in 0.405s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-57aab90d-a9aa-4670-9299-fa767fee16a5" released by "delete_volume" :: held 0.903s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Created reservations ['b514d6d1-036d-4e21-b419-d1742786d7dc', '81299203-11f9-4f77-877b-193c2da3bd39', 'e180d729-3de1-49b0-8a6a-4d298a6a3301', '915c56e1-ed4c-42d6-bbb9-9aa932004a3b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:51 devstack sudo[89970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:51 devstack sudo[89970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "cinder-quobyte-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf23898-8d37-45e6-bf16-f42e7e2209a2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:51 devstack sudo[89972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 Apr 13 11:07:51 devstack sudo[89972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:51 devstack sudo[89970]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.426s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:51 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Deleted volume successfully. Apr 13 11:07:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e35b9768-c7a5-4448-a8a3-50784812a479 tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-57aab90d-a9aa-4670-9299-fa767fee16a5-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:52 devstack sudo[89972]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" returned: 0 in 0.485s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:52 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7 Apr 13 11:07:52 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:52 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" returned: 0 in 0.408s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-quobyte-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7" released by "delete_volume" :: held 0.915s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Created reservations ['75fa854a-15f1-415b-9b22-f4d69bb06fad', '7822f2d9-d02f-4ae8-a14a-1ff09b758bf2', 'ef690b78-1f9e-455a-b4b1-b6b7be5c62df', '6b8f7602-758d-4204-a416-7d10a5a10925'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:07:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:07:52 devstack sudo[89982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:07:52 devstack sudo[89982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:07:53 devstack sudo[89982]: pam_unix(sudo:session): session closed for user root Apr 13 11:07:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:07:53 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:07:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Deleted volume successfully. Apr 13 11:07:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-43c42495-65f1-449c-8851-e5f5792f6dfa tempest-VolumeDependencyTests-1639924013 None] Lock "cinder-1ff8aa01-3fe7-484b-ad54-f2a93f0857d7-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Flow 'volume_create_manager' (a9d3f079-f806-4baa-a731-c810a2d0ee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493fb08-cf33-4bf2-b602-28cfcf42fb1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a493fb08-cf33-4bf2-b602-28cfcf42fb1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1118740901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1fdc173506d4dd48f806c9ac83610fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:05Z,use_quota=True,user_id='f8ee09cbcbe2488dadf64e482554369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2390286b-f78a-46ae-9327-2e5f5b15a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2390286b-f78a-46ae-9327-2e5f5b15a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efef749-95e7-4e0c-83ba-2410831141a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0efef749-95e7-4e0c-83ba-2410831141a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd4b4acd7-c7f3-487f-9f04-5fcc4630e1a1', 'volume_name': 'volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2390038-657c-41ef-af76-300a08f2239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2390038-657c-41ef-af76-300a08f2239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a920bbb7-fc35-46a4-8fb3-f325a0128436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:04 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Volume d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1', 'volume_size': 1} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1118740901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1fdc173506d4dd48f806c9ac83610fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:05Z,use_quota=True,user_id='f8ee09cbcbe2488dadf64e482554369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Creating volume d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:04 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:04 devstack sudo[89986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 1073741824 Apr 13 11:08:04 devstack sudo[89986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:05 devstack sudo[89986]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 1073741824" returned: 0 in 0.496s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:05 devstack sudo[89991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 Apr 13 11:08:05 devstack sudo[89991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:05 devstack sudo[89991]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" returned: 0 in 0.443s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a920bbb7-fc35-46a4-8fb3-f325a0128436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7aacef1-109c-4bc2-814b-22764ec0ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:05 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Volume volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 (d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1): created successfully Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7aacef1-109c-4bc2-814b-22764ec0ad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Flow 'volume_create_manager' (a9d3f079-f806-4baa-a731-c810a2d0ee6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-0a8f9716-6f54-446b-b004-033ac39b8c47 tempest-SnapshotDependencyTests-1422962344 None] Created volume successfully. Apr 13 11:08:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Creating offline snapshot 6602c8c7-870b-4e9d-adc4-1ce6f893259b of volume d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:08:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f54399-5935-4eba-8f48-5b61c02587b8]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:07 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 Apr 13 11:08:07 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:07 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" returned: 0 in 0.473s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:07 devstack sudo[90000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b 1G Apr 13 11:08:07 devstack sudo[90000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:08 devstack sudo[90000]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b 1G" returned: 0 in 0.469s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:08 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b Apr 13 11:08:08 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:08 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b" returned: 0 in 0.426s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:08 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b is being set with open permissions: ugo+rw Apr 13 11:08:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:08 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b Apr 13 11:08:08 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:08 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b" returned: 0 in 0.398s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:08 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=78,cinder:INSERT=31,cinder:UPDATE=103,cinder:DELETE=13 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:08:08 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=80,cinder:INSERT=27,cinder:UPDATE=85,cinder:DELETE=4 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:08:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:09 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.info Apr 13 11:08:09 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:09 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.info" returned: 0 in 0.419s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:09 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.info is being set with open permissions: ugo+rw Apr 13 11:08:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:09 devstack sudo[90016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.info Apr 13 11:08:09 devstack sudo[90016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:09 devstack sudo[90016]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.info" returned: 0 in 0.402s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.650s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:09 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-975244af-b1e3-4265-a0e8-646cb7483710 tempest-SnapshotDependencyTests-1422962344 None] Create snapshot completed successfully Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Flow 'volume_create_manager' (2d991b4c-1abc-41a2-af24-bb31832bdaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fee7cd-6c34-4af5-882d-000f57fe1d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fee7cd-6c34-4af5-882d-000f57fe1d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:10Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fb3a2dc-2717-4bf1-a962-b6afc0be4073,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1fdc173506d4dd48f806c9ac83610fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6602c8c7-870b-4e9d-adc4-1ce6f893259b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:11Z,use_quota=True,user_id='f8ee09cbcbe2488dadf64e482554369f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8110595-cfbb-4bf8-9a05-a4cd40d79247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8110595-cfbb-4bf8-9a05-a4cd40d79247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f181c4f4-9cb4-4390-8583-4a57de48eb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f181c4f4-9cb4-4390-8583-4a57de48eb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5fb3a2dc-2717-4bf1-a962-b6afc0be4073', 'volume_name': 'volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073', 'volume_size': 1, 'snapshot_id': '6602c8c7-870b-4e9d-adc4-1ce6f893259b'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58531ee-d471-4cb3-b836-7892d8af9652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d58531ee-d471-4cb3-b836-7892d8af9652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01344cb1-6de6-4fdb-ac80-f58cd1672e73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:10 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Volume 5fb3a2dc-2717-4bf1-a962-b6afc0be4073: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073', 'volume_size': 1, 'snapshot_id': '6602c8c7-870b-4e9d-adc4-1ce6f893259b'} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-quobyte-6602c8c7-870b-4e9d-adc4-1ce6f893259b-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" by "_create_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-6602c8c7-870b-4e9d-adc4-1ce6f893259b-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Creating volume 5fb3a2dc-2717-4bf1-a962-b6afc0be4073 from snapshot 6602c8c7-870b-4e9d-adc4-1ce6f893259b {{(pid=82656) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-quobyte-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" acquired by "_copy_volume_from_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] snapshot: 6602c8c7-870b-4e9d-adc4-1ce6f893259b, volume: 5fb3a2dc-2717-4bf1-a962-b6afc0be4073, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78b22f6-cf15-40b3-9c4c-5c304429a2c2]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:10 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b Apr 13 11:08:10 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:11 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b" returned: 0 in 0.493s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b098d7-b381-4fa2-8a67-8b6e68907edf]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:11 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 Apr 13 11:08:11 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:11 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" returned: 0 in 0.462s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:08:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:11 devstack sudo[90029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 Apr 13 11:08:11 devstack sudo[90029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:13 devstack sudo[90029]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" returned: 0 in 1.805s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:13 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3ddafb-f3e9-4895-905e-aa107d06c060]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:13 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 Apr 13 11:08:13 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:14 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" returned: 0 in 0.582s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1, size 1024.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:08:14 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Converted 1024.00 MB image at 567.03 MB/s Apr 13 11:08:14 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 is being set with open permissions: ugo+rw Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:14 devstack sudo[90047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 Apr 13 11:08:14 devstack sudo[90047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:14 devstack sudo[90047]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" returned: 0 in 0.400s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" released by "_copy_volume_from_snapshot" :: held 3.795s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-6602c8c7-870b-4e9d-adc4-1ce6f893259b-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" released by "_create_volume_from_snapshot" :: held 3.811s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 3.826s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01344cb1-6de6-4fdb-ac80-f58cd1672e73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073', 'volume_size': 1, 'snapshot_id': '6602c8c7-870b-4e9d-adc4-1ce6f893259b'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63794d08-456c-48da-b31c-0f9639a20321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:14 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Volume volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 (5fb3a2dc-2717-4bf1-a962-b6afc0be4073): created successfully Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63794d08-456c-48da-b31c-0f9639a20321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Flow 'volume_create_manager' (2d991b4c-1abc-41a2-af24-bb31832bdaa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:14 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-54186ec9-97d5-417b-9a0b-381e0d865aa9 tempest-SnapshotDependencyTests-1422962344 None] Created volume successfully. Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-6602c8c7-870b-4e9d-adc4-1ce6f893259b-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-6602c8c7-870b-4e9d-adc4-1ce6f893259b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-quobyte-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" acquired by "delete_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-quobyte-6602c8c7-870b-4e9d-adc4-1ce6f893259b" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-6602c8c7-870b-4e9d-adc4-1ce6f893259b" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Deleting offline snapshot 6602c8c7-870b-4e9d-adc4-1ce6f893259b of volume d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] snapshot_file for this snap is: volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa03391f-bea0-451f-a0f9-341351d50f4f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:14 devstack sudo[90050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b Apr 13 11:08:14 devstack sudo[90050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:15 devstack sudo[90050]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b" returned: 0 in 0.474s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:15 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:08:15 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9423a083-9c67-41af-b135-504251467266]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:15 devstack sudo[90057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 Apr 13 11:08:15 devstack sudo[90057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:15 devstack sudo[90057]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" returned: 0 in 0.451s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:15 devstack sudo[90062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b Apr 13 11:08:15 devstack sudo[90062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:16 devstack sudo[90062]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b" returned: 0 in 0.438s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:16 devstack sudo[90067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b Apr 13 11:08:16 devstack sudo[90067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:16 devstack sudo[90067]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1.6602c8c7-870b-4e9d-adc4-1ce6f893259b" returned: 0 in 0.396s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-6602c8c7-870b-4e9d-adc4-1ce6f893259b" released by "_delete_snapshot" :: held 1.811s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" released by "delete_snapshot" :: held 1.823s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Created reservations ['a78b6ce7-03e9-41f3-983b-72a314485e56', '6f1b42d2-022e-4405-ad81-cd1c411ec8a6', 'a8750bf7-0fe2-427d-84a8-ebe05e3fb6b7', '68dfa051-2ecd-4a83-8cd2-916b9f70aced'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:16 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Delete snapshot completed successfully. Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dfd1a764-f0c6-48bb-bb80-94b960f1b868 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-6602c8c7-870b-4e9d-adc4-1ce6f893259b-delete_snapshot" released by "delete_snapshot" :: held 1.901s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1-delete_volume" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-quobyte-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bad8d27-21ae-4f15-adc6-6b155803c13f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:17 devstack sudo[90070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 Apr 13 11:08:17 devstack sudo[90070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:17 devstack sudo[90070]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" returned: 0 in 0.463s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:17 devstack sudo[90075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1 Apr 13 11:08:17 devstack sudo[90075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:17 devstack sudo[90075]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" returned: 0 in 0.390s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1" released by "delete_volume" :: held 0.893s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Created reservations ['b2314909-8964-4e8f-aa2e-8383988f9eb7', '9c107fc6-07ec-4336-8fa9-d8c571fb6e90', '9acd74d7-16bf-4791-9e67-a786f3affbd9', '38b042b0-a776-4c1c-bfa1-afca8c11f5b4'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:18 devstack sudo[90078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:18 devstack sudo[90078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-5fb3a2dc-2717-4bf1-a962-b6afc0be4073-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-5fb3a2dc-2717-4bf1-a962-b6afc0be4073-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "cinder-quobyte-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" acquired by "delete_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9588339f-1bb7-4d11-a304-2179936adada]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:18 devstack sudo[90080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 Apr 13 11:08:18 devstack sudo[90080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:18 devstack sudo[90078]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.445s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:18 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Deleted volume successfully. Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-dc6404e7-ff67-45ea-9870-fd440359ce59 tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-d4b4acd7-c7f3-487f-9f04-5fcc4630e1a1-delete_volume" released by "delete_volume" :: held 1.458s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:18 devstack sudo[90080]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" returned: 0 in 0.488s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:18 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073 Apr 13 11:08:18 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:19 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" returned: 0 in 0.402s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-quobyte-5fb3a2dc-2717-4bf1-a962-b6afc0be4073" released by "delete_volume" :: held 0.911s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Created reservations ['c0fd08b2-653c-40c9-a71e-fa7addf9619c', '678689a7-1292-4c92-bbd9-7b675246faed', '74a8935b-6177-41e0-a9da-266f2546fc09', 'ebda10e8-d1b9-4ab1-b55c-06f51c70155e'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:19 devstack sudo[90090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:19 devstack sudo[90090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:19 devstack sudo[90090]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.440s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:19 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Deleted volume successfully. Apr 13 11:08:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d58e99ff-b7e6-492e-9751-c72dba4c7e3a tempest-SnapshotDependencyTests-1422962344 None] Lock "cinder-5fb3a2dc-2717-4bf1-a962-b6afc0be4073-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:29 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=22,cinder:UPDATE=20,cinder:INSERT=6 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:08:29 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=17,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=4 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Flow 'volume_create_manager' (07ec6c71-4bed-4305-a2c4-479a62f37268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68c6a51-e290-4661-8058-74898ac204fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b68c6a51-e290-4661-8058-74898ac204fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fba7bf-35d2-417f-8d59-cf7109c70060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8150c2e7ae2c4dd9bc526c77e3e69db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='2322f935703e486f959be91daa610fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127aac82-9c33-43b9-a9b3-a5f739ed035e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127aac82-9c33-43b9-a9b3-a5f739ed035e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4eb4df-125a-476a-96a1-e6580016ba19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec4eb4df-125a-476a-96a1-e6580016ba19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73fba7bf-35d2-417f-8d59-cf7109c70060', 'volume_name': 'volume-73fba7bf-35d2-417f-8d59-cf7109c70060', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fb45c3-af0f-4fe8-b405-031e1ea70b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3fb45c3-af0f-4fe8-b405-031e1ea70b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1907b7ac-4ba2-4fa1-bbd4-22282644aa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Volume 73fba7bf-35d2-417f-8d59-cf7109c70060: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73fba7bf-35d2-417f-8d59-cf7109c70060', 'volume_size': 1} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73fba7bf-35d2-417f-8d59-cf7109c70060,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8150c2e7ae2c4dd9bc526c77e3e69db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='2322f935703e486f959be91daa610fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Creating volume 73fba7bf-35d2-417f-8d59-cf7109c70060 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:31 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:31 devstack sudo[90145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 1073741824 Apr 13 11:08:31 devstack sudo[90145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (551642d6-20d2-4143-95f3-37260087dafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bfc931-e117-4fec-9563-aa44646731ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0bfc931-e117-4fec-9563-aa44646731ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-12416320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017e7c84-f76f-44c6-9785-dba1e4146439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a166123-ad0c-48a5-91bf-6028d9905a20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a166123-ad0c-48a5-91bf-6028d9905a20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a8076-eaab-4682-83e3-9878fdd2fb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594a8076-eaab-4682-83e3-9878fdd2fb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '017e7c84-f76f-44c6-9785-dba1e4146439', 'volume_name': 'volume-017e7c84-f76f-44c6-9785-dba1e4146439', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd939fc9-c362-4b26-858c-7d9f10fff7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd939fc9-c362-4b26-858c-7d9f10fff7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a30ae49-f8fa-464b-971f-3c9c2b0cf03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume 017e7c84-f76f-44c6-9785-dba1e4146439: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-017e7c84-f76f-44c6-9785-dba1e4146439', 'volume_size': 1} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Flow 'volume_create_manager' (80ac51db-8fca-4c86-9816-144fda793e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e68b73-0fbb-4ea7-bd4f-6a95e88a068e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9e68b73-0fbb-4ea7-bd4f-6a95e88a068e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-894784056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0075bdd4-f677-4365-a07b-329f3f557334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da680498139410b95c2c99ae7b5c969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='b744331d94bb4b2c8baa32d39302cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200f1f09-ba7d-4d8b-8e7c-8e72c8a19ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (200f1f09-ba7d-4d8b-8e7c-8e72c8a19ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd471b71-6b09-4b48-a04c-6d6898da333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd471b71-6b09-4b48-a04c-6d6898da333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0075bdd4-f677-4365-a07b-329f3f557334', 'volume_name': 'volume-0075bdd4-f677-4365-a07b-329f3f557334', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60500cd2-f4ec-4d7a-b11d-647b1c28aa12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60500cd2-f4ec-4d7a-b11d-647b1c28aa12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47c052b-3d0b-4862-91a5-73f859aeffed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Volume 0075bdd4-f677-4365-a07b-329f3f557334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0075bdd4-f677-4365-a07b-329f3f557334', 'volume_size': 1} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (f792cb67-e1ea-456c-a959-4ef6e13ef658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c02503-5d02-45fd-b7c5-dfcd7988ba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4c02503-5d02-45fd-b7c5-dfcd7988ba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-588327721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cb5c4b-0683-4da9-85c7-82d5ff541096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fc46bc-9e9e-4c2e-95c2-b9326bb73a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0fc46bc-9e9e-4c2e-95c2-b9326bb73a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc503c89-5efb-4306-a591-6fca8d93fb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc503c89-5efb-4306-a591-6fca8d93fb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61cb5c4b-0683-4da9-85c7-82d5ff541096', 'volume_name': 'volume-61cb5c4b-0683-4da9-85c7-82d5ff541096', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df998e4b-8fb0-4195-929a-f98f975d646c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df998e4b-8fb0-4195-929a-f98f975d646c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d832d3-b8fb-4330-9c7f-fc986872b83c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Volume 61cb5c4b-0683-4da9-85c7-82d5ff541096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61cb5c4b-0683-4da9-85c7-82d5ff541096', 'volume_size': 1} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (1bc262ac-1735-4084-997b-12c2e42f0fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac6c3c8-8e5c-47be-b345-4ac207666720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac6c3c8-8e5c-47be-b345-4ac207666720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1271620039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32b8bb7-64da-48b5-80e9-1639911f2696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5294cf-16bd-4076-a7e5-506e9f6fd5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb5294cf-16bd-4076-a7e5-506e9f6fd5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3f6812-01c9-48d2-a817-506df21458de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd3f6812-01c9-48d2-a817-506df21458de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd32b8bb7-64da-48b5-80e9-1639911f2696', 'volume_name': 'volume-d32b8bb7-64da-48b5-80e9-1639911f2696', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36286369-cbcb-41a5-b8d9-db1ded4a0d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36286369-cbcb-41a5-b8d9-db1ded4a0d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1606e0dc-f750-4aca-9b8a-433f9e3ce764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Volume d32b8bb7-64da-48b5-80e9-1639911f2696: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d32b8bb7-64da-48b5-80e9-1639911f2696', 'volume_size': 1} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:31 devstack sudo[90145]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 1073741824" returned: 0 in 0.621s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:31 devstack sudo[90150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 Apr 13 11:08:31 devstack sudo[90150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (b53db0a9-f90d-4445-a1e2-36a99fdfdd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922c01c5-d0c5-4747-9b76-ba381f70c9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (922c01c5-d0c5-4747-9b76-ba381f70c9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806764171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca933fa-6c82-443d-a8fb-17e9abb05a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:32Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8169e728-42d9-4c89-8fae-ebc479157932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8169e728-42d9-4c89-8fae-ebc479157932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7980f29-9f94-42bd-a54f-8ced5a404636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7980f29-9f94-42bd-a54f-8ced5a404636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca933fa-6c82-443d-a8fb-17e9abb05a37', 'volume_name': 'volume-cca933fa-6c82-443d-a8fb-17e9abb05a37', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e88b0e-af08-4d8e-a86f-5f4ce76667bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34e88b0e-af08-4d8e-a86f-5f4ce76667bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417b7f92-eee5-4818-9555-0f214e077d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Volume cca933fa-6c82-443d-a8fb-17e9abb05a37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca933fa-6c82-443d-a8fb-17e9abb05a37', 'volume_size': 1} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (60a7cbff-f392-4dbb-a681-7dee84a3deda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401c4e6b-eb64-45dd-9430-e330d9bc6448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (401c4e6b-eb64-45dd-9430-e330d9bc6448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910321629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:32Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a5f046-74e5-4b96-a60f-0f5d590ce877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2a5f046-74e5-4b96-a60f-0f5d590ce877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedd47b7-0445-41b7-80f2-3f83646b1203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aedd47b7-0445-41b7-80f2-3f83646b1203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6', 'volume_name': 'volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a936bd0-6d27-4245-a999-30874ec46413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a936bd0-6d27-4245-a999-30874ec46413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d2e830-8ac0-409d-84e1-c816383e2c8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:31 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Volume b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6', 'volume_size': 1} Apr 13 11:08:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (5c067c0b-5ae7-4917-8181-b01b286ff3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c4cb03-6e77-46b5-b7af-d7d9fb452995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8c4cb03-6e77-46b5-b7af-d7d9fb452995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1163222630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d896abb5-15bd-409d-b1f2-1aee1b267250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:32Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e924a559-48de-420c-9c7e-01f6b18ebcfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e924a559-48de-420c-9c7e-01f6b18ebcfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b925be-80c2-4b14-b8cc-1e697adc51b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b925be-80c2-4b14-b8cc-1e697adc51b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd896abb5-15bd-409d-b1f2-1aee1b267250', 'volume_name': 'volume-d896abb5-15bd-409d-b1f2-1aee1b267250', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282a2dbd-24b0-497d-a9b2-ec11a85608d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (282a2dbd-24b0-497d-a9b2-ec11a85608d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb2f90e-7575-4e20-821b-c3d4724b4a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:32 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Volume d896abb5-15bd-409d-b1f2-1aee1b267250: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d896abb5-15bd-409d-b1f2-1aee1b267250', 'volume_size': 1} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:32 devstack sudo[90150]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060" returned: 0 in 0.488s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] <== create_volume: return (1141ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.042s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-12416320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=017e7c84-f76f-44c6-9785-dba1e4146439,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Creating volume 017e7c84-f76f-44c6-9785-dba1e4146439 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:32 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1907b7ac-4ba2-4fa1-bbd4-22282644aa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73fba7bf-35d2-417f-8d59-cf7109c70060', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:32 devstack sudo[90154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 1073741824 Apr 13 11:08:32 devstack sudo[90154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940e1ed6-0875-415d-ab56-07ce72ead6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:32 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Volume volume-73fba7bf-35d2-417f-8d59-cf7109c70060 (73fba7bf-35d2-417f-8d59-cf7109c70060): created successfully Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (940e1ed6-0875-415d-ab56-07ce72ead6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Flow 'volume_create_manager' (07ec6c71-4bed-4305-a2c4-479a62f37268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:32 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6882bad8-0ad5-44b1-9df1-04112a5fa158 tempest-CinderUnicodeTest-1469040465 None] Created volume successfully. Apr 13 11:08:32 devstack sudo[90154]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 1073741824" returned: 0 in 0.521s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:32 devstack sudo[90159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 Apr 13 11:08:32 devstack sudo[90159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:33 devstack sudo[90159]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439" returned: 0 in 0.431s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.981s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.948s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-894784056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0075bdd4-f677-4365-a07b-329f3f557334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da680498139410b95c2c99ae7b5c969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='b744331d94bb4b2c8baa32d39302cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Creating volume 0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:33 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a30ae49-f8fa-464b-971f-3c9c2b0cf03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-017e7c84-f76f-44c6-9785-dba1e4146439', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ddd891-661d-4b91-a75f-d9df28a64ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:33 devstack sudo[90162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 1073741824 Apr 13 11:08:33 devstack sudo[90162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:33 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume volume-017e7c84-f76f-44c6-9785-dba1e4146439 (017e7c84-f76f-44c6-9785-dba1e4146439): created successfully Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74ddd891-661d-4b91-a75f-d9df28a64ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (551642d6-20d2-4143-95f3-37260087dafd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:33 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4d8ad8fa-b9cb-4164-a005-1d7d589a1c04 tempest-CreateVolumesFromSnapshotTest-566772390 None] Created volume successfully. Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Flow 'volume_create_manager' (ba26cdd8-63c9-41a1-bae3-a8bdac6a7be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2f1649-f719-4add-98f6-938a682408e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da2f1649-f719-4add-98f6-938a682408e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1299421155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8150c2e7ae2c4dd9bc526c77e3e69db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:34Z,use_quota=True,user_id='2322f935703e486f959be91daa610fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71953257-b1d3-4e39-b4c3-feafcb503b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71953257-b1d3-4e39-b4c3-feafcb503b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d8102e-66b1-42b7-85c1-daf477a6dcd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44d8102e-66b1-42b7-85c1-daf477a6dcd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5', 'volume_name': 'volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38a68f0-987f-41e5-adf6-b46300668804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d38a68f0-987f-41e5-adf6-b46300668804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee0ca65-b158-4828-ad7c-8c49dcd045c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:33 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Volume 7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5', 'volume_size': 1} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:33 devstack sudo[90162]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 1073741824" returned: 0 in 0.622s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:33 devstack sudo[90167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 Apr 13 11:08:33 devstack sudo[90167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:34 devstack sudo[90167]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334" returned: 0 in 0.419s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.874s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-588327721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61cb5c4b-0683-4da9-85c7-82d5ff541096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Creating volume 61cb5c4b-0683-4da9-85c7-82d5ff541096 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:34 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47c052b-3d0b-4862-91a5-73f859aeffed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0075bdd4-f677-4365-a07b-329f3f557334', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2add39-e0ff-47b8-942b-922ff8fe42e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:34 devstack sudo[90170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 1073741824 Apr 13 11:08:34 devstack sudo[90170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:34 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Volume volume-0075bdd4-f677-4365-a07b-329f3f557334 (0075bdd4-f677-4365-a07b-329f3f557334): created successfully Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b2add39-e0ff-47b8-942b-922ff8fe42e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Flow 'volume_create_manager' (80ac51db-8fca-4c86-9816-144fda793e6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:34 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-41b74ad1-5d64-47e2-a8b2-f0354fe58cf2 tempest-VolumeDependencyTests-126835413 None] Created volume successfully. Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:34 devstack sudo[90170]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 1073741824" returned: 0 in 0.551s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:34 devstack sudo[90175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 Apr 13 11:08:34 devstack sudo[90175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:35 devstack sudo[90175]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096" returned: 0 in 0.420s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.680s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1271620039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d32b8bb7-64da-48b5-80e9-1639911f2696,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:31Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Creating volume d32b8bb7-64da-48b5-80e9-1639911f2696 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:35 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34d832d3-b8fb-4330-9c7f-fc986872b83c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61cb5c4b-0683-4da9-85c7-82d5ff541096', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4d61c2-10ed-4f36-b7a4-b52b04ce1b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:35 devstack sudo[90178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 1073741824 Apr 13 11:08:35 devstack sudo[90178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:35 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Volume volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 (61cb5c4b-0683-4da9-85c7-82d5ff541096): created successfully Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c4d61c2-10ed-4f36-b7a4-b52b04ce1b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (f792cb67-e1ea-456c-a959-4ef6e13ef658) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:35 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3a5c8406-740e-4e17-a6be-599790c51695 tempest-CreateVolumesFromImageTest-1386700956 None] Created volume successfully. Apr 13 11:08:35 devstack sudo[90178]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 1073741824" returned: 0 in 0.495s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:35 devstack sudo[90183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 Apr 13 11:08:35 devstack sudo[90183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:36 devstack sudo[90183]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696" returned: 0 in 0.410s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.376s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-806764171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca933fa-6c82-443d-a8fb-17e9abb05a37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:32Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Creating volume cca933fa-6c82-443d-a8fb-17e9abb05a37 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:36 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1606e0dc-f750-4aca-9b8a-433f9e3ce764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d32b8bb7-64da-48b5-80e9-1639911f2696', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383d945a-29d8-485a-815b-10aa202ead20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:36 devstack sudo[90186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 1073741824 Apr 13 11:08:36 devstack sudo[90186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:36 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Volume volume-d32b8bb7-64da-48b5-80e9-1639911f2696 (d32b8bb7-64da-48b5-80e9-1639911f2696): created successfully Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (383d945a-29d8-485a-815b-10aa202ead20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (1bc262ac-1735-4084-997b-12c2e42f0fa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:36 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3743bbd1-e70a-4231-9457-da3908af242e tempest-CreateVolumesFromImageTest-1386700956 None] Created volume successfully. Apr 13 11:08:36 devstack sudo[90186]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 1073741824" returned: 0 in 0.508s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:36 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:36 devstack sudo[90191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 Apr 13 11:08:36 devstack sudo[90191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:37 devstack sudo[90191]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37" returned: 0 in 0.394s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.153s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1910321629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:32Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Creating volume b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:37 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417b7f92-eee5-4818-9555-0f214e077d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca933fa-6c82-443d-a8fb-17e9abb05a37', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfb1654-665c-435f-a581-54e3a0dc7c3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:37 devstack sudo[90194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 1073741824 Apr 13 11:08:37 devstack sudo[90194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:37 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Volume volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 (cca933fa-6c82-443d-a8fb-17e9abb05a37): created successfully Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbfb1654-665c-435f-a581-54e3a0dc7c3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (b53db0a9-f90d-4445-a1e2-36a99fdfdd6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:37 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d34b57ff-0a9b-433e-88a5-c420ad33584a tempest-CreateVolumesFromImageTest-1386700956 None] Created volume successfully. Apr 13 11:08:37 devstack sudo[90194]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 1073741824" returned: 0 in 0.494s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:37 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:37 devstack sudo[90199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 Apr 13 11:08:37 devstack sudo[90199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:38 devstack sudo[90199]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6" returned: 0 in 0.412s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.898s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1163222630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d896abb5-15bd-409d-b1f2-1aee1b267250,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2c0fc70fea944538f470b179784a578',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:32Z,use_quota=True,user_id='8c5e5ea45d8244c1846736142bad1317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Creating volume d896abb5-15bd-409d-b1f2-1aee1b267250 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:38 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68d2e830-8ac0-409d-84e1-c816383e2c8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f81066-4b63-4d2a-b1ac-eba1f18fd571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:38 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 1073741824 Apr 13 11:08:38 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Volume volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 (b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6): created successfully Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5f81066-4b63-4d2a-b1ac-eba1f18fd571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (60a7cbff-f392-4dbb-a681-7dee84a3deda) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:38 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-aeb98e69-0968-43b0-84ce-6f1b250a8eb4 tempest-CreateVolumesFromImageTest-1386700956 None] Created volume successfully. Apr 13 11:08:38 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 1073741824" returned: 0 in 0.494s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:38 devstack sudo[90207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 Apr 13 11:08:38 devstack sudo[90207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:38 devstack sudo[90209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:38 devstack sudo[90209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:38 devstack sudo[90207]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250" returned: 0 in 0.420s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.521s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5eb2f90e-7575-4e20-821b-c3d4724b4a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d896abb5-15bd-409d-b1f2-1aee1b267250', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769697f0-385e-4281-9624-2cb472c50799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:38 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Volume volume-d896abb5-15bd-409d-b1f2-1aee1b267250 (d896abb5-15bd-409d-b1f2-1aee1b267250): created successfully Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (769697f0-385e-4281-9624-2cb472c50799) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Flow 'volume_create_manager' (5c067c0b-5ae7-4917-8181-b01b286ff3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Creating offline snapshot 4838ba9d-5063-4c1f-a3cf-421072b61934 of volume 017e7c84-f76f-44c6-9785-dba1e4146439 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:08:38 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-84fe0842-ae04-4b4d-a5b5-5af9fe2d35e9 tempest-CreateVolumesFromImageTest-1386700956 None] Created volume successfully. Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b98504b-30ab-4090-ba78-3c91182877ae]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:39 devstack sudo[90212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 Apr 13 11:08:39 devstack sudo[90212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:39 devstack sudo[90209]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.412s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:39 devstack sudo[90212]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:39 devstack sudo[90218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 1G Apr 13 11:08:39 devstack sudo[90218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-d896abb5-15bd-409d-b1f2-1aee1b267250-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-d896abb5-15bd-409d-b1f2-1aee1b267250-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-quobyte-d896abb5-15bd-409d-b1f2-1aee1b267250" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-d896abb5-15bd-409d-b1f2-1aee1b267250" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bca9524-fbc6-4873-9ef3-fef2633b7b03]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:39 devstack sudo[90252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 Apr 13 11:08:39 devstack sudo[90252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:40 devstack sudo[90218]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 1G" returned: 0 in 0.534s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017e7c84-f76f-44c6-9785-dba1e4146439 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:40 devstack sudo[90259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017e7c84-f76f-44c6-9785-dba1e4146439 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 Apr 13 11:08:40 devstack sudo[90259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:40 devstack sudo[90252]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250" returned: 0 in 0.493s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:40 devstack sudo[90264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250 Apr 13 11:08:40 devstack sudo[90264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:40 devstack sudo[90259]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-017e7c84-f76f-44c6-9785-dba1e4146439 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934" returned: 0 in 0.438s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:40 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 is being set with open permissions: ugo+rw Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:40 devstack sudo[90269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 Apr 13 11:08:40 devstack sudo[90269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:40 devstack sudo[90264]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d896abb5-15bd-409d-b1f2-1aee1b267250" returned: 0 in 0.415s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-d896abb5-15bd-409d-b1f2-1aee1b267250" released by "delete_volume" :: held 0.966s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Created reservations ['6fd63bed-fa39-4765-9e69-61f4b7961e0f', 'b268404a-515e-40b0-855b-43df45f9a11b', '714f502e-82d6-41f4-8c69-9af121f2de22', 'cb226aba-d83b-42f8-99cb-8b92de0cbfd8'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:40 devstack sudo[90272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:40 devstack sudo[90272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:40 devstack sudo[90269]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934" returned: 0 in 0.440s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:40 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:40 devstack sudo[90275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.info Apr 13 11:08:40 devstack sudo[90275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:41 devstack sudo[90272]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.441s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:41 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Deleted volume successfully. Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e475894f-6d03-4bf2-adde-1a7956a69d34 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-d896abb5-15bd-409d-b1f2-1aee1b267250-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:41 devstack sudo[90275]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.info" returned: 0 in 0.410s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:41 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.info is being set with open permissions: ugo+rw Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:41 devstack sudo[90279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.info Apr 13 11:08:41 devstack sudo[90279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:41 devstack sudo[90279]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.info" returned: 0 in 0.419s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.831s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.189s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1299421155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8150c2e7ae2c4dd9bc526c77e3e69db6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:34Z,use_quota=True,user_id='2322f935703e486f959be91daa610fac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Creating volume 7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:41 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:41 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 1073741824 Apr 13 11:08:41 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:41 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-85d95c5c-ce08-4fd3-ac73-45f1d11bf5b6 tempest-CreateVolumesFromSnapshotTest-566772390 None] Create snapshot completed successfully Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-quobyte-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26477d6-96a4-43af-bea5-3583c09fc313]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:41 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:41 devstack sudo[90287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 Apr 13 11:08:41 devstack sudo[90287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:42 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 1073741824" returned: 0 in 0.504s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:42 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 Apr 13 11:08:42 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:42 devstack sudo[90287]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6" returned: 0 in 0.507s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:42 devstack sudo[90297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6 Apr 13 11:08:42 devstack sudo[90297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:42 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" returned: 0 in 0.415s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] <== create_volume: return (954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.280s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee0ca65-b158-4828-ad7c-8c49dcd045c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3aac04-cfe3-4f29-a835-8f8e0d65c5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Creating offline snapshot fec9fadd-3bc0-4c6c-93de-85add08db2d5 of volume 0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:08:42 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Volume volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 (7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5): created successfully Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f3aac04-cfe3-4f29-a835-8f8e0d65c5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Flow 'volume_create_manager' (ba26cdd8-63c9-41a1-bae3-a8bdac6a7be1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0359dfb9-4eaa-4658-a8ee-e30f35f83a19]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:42 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b4472daa-3725-4f64-a077-2c29a2291633 tempest-CinderUnicodeTest-1469040465 None] Created volume successfully. Apr 13 11:08:42 devstack sudo[90297]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6" returned: 0 in 0.408s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6" released by "delete_volume" :: held 0.950s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Created reservations ['f3323c37-06cf-48bf-a8ff-96cf2d4ca087', '29a989aa-66d6-4179-8f37-a9202f3cee46', '4ef289be-c2fb-44eb-9aad-03976c35717c', '05be8527-f747-4305-87b1-f36f4d38d953'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:42 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 Apr 13 11:08:42 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:42 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:42 devstack sudo[90303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:42 devstack sudo[90303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (6345fc30-0234-4124-a5bc-456c3ce33da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1857f119-2c34-471e-84f3-b6660d1f7037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1857f119-2c34-471e-84f3-b6660d1f7037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789126451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d18bd89-a87e-49ce-8eda-88df692433cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:43Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ea1a8a-cf49-4ab7-b0e2-0c32713ca008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19ea1a8a-cf49-4ab7-b0e2-0c32713ca008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e27f12-e655-4902-8400-962ad027c20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e27f12-e655-4902-8400-962ad027c20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d18bd89-a87e-49ce-8eda-88df692433cd', 'volume_name': 'volume-4d18bd89-a87e-49ce-8eda-88df692433cd', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd246763-7633-4bb1-9955-4f0d1a456897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd246763-7633-4bb1-9955-4f0d1a456897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0555bce2-9f72-4782-85fb-5200d70d7ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume 4d18bd89-a87e-49ce-8eda-88df692433cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d18bd89-a87e-49ce-8eda-88df692433cd', 'volume_size': 1} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (4b010e3d-323b-4994-a413-c04f32d5f37d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7dfcc2-f324-4cef-8172-025e16e666e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c7dfcc2-f324-4cef-8172-025e16e666e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1938761759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0143b0e9-812e-4a36-9a29-5b324df772a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:43Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4d496a-4336-42d0-956f-ea0685921df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe4d496a-4336-42d0-956f-ea0685921df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fa1888-d9ec-46d8-a222-0c05e9543cf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82fa1888-d9ec-46d8-a222-0c05e9543cf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0143b0e9-812e-4a36-9a29-5b324df772a7', 'volume_name': 'volume-0143b0e9-812e-4a36-9a29-5b324df772a7', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba5ffce-848f-46c0-9129-8591068b7773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ba5ffce-848f-46c0-9129-8591068b7773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645c5c64-7635-4b85-a8cc-40fae013ecfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume 0143b0e9-812e-4a36-9a29-5b324df772a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0143b0e9-812e-4a36-9a29-5b324df772a7', 'volume_size': 1} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:43 devstack sudo[90303]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.518s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:43 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Deleted volume successfully. Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-815b041c-11b8-4166-956f-a6cac4aee070 tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-b9d3c6ec-d1dc-467e-aaf3-4ae1e6ca11d6-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:43 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334" returned: 0 in 0.669s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:43 devstack sudo[90309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 1G Apr 13 11:08:43 devstack sudo[90309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (6cb1114d-f1ef-456e-97d5-286bc6c1ff27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfca978-c86a-4138-9a75-7752c4fd2045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dfca978-c86a-4138-9a75-7752c4fd2045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2118952351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7dae95-4f37-4ce1-80a4-2df03969a751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:43Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f876e6-f2c0-45f7-81ef-f3501b146d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f876e6-f2c0-45f7-81ef-f3501b146d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084bba15-b869-4eb4-a251-9fa9eb74491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (084bba15-b869-4eb4-a251-9fa9eb74491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d7dae95-4f37-4ce1-80a4-2df03969a751', 'volume_name': 'volume-4d7dae95-4f37-4ce1-80a4-2df03969a751', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892cb738-d153-4830-b4e0-a028dc063ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (892cb738-d153-4830-b4e0-a028dc063ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da45b166-3d7b-49d2-b63d-739b9240a4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume 4d7dae95-4f37-4ce1-80a4-2df03969a751: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d7dae95-4f37-4ce1-80a4-2df03969a751', 'volume_size': 1} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (067962a7-83c2-497d-a9d8-00c2aa6b6e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ced6068-fc2f-46ed-8242-c58ea10b5dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ced6068-fc2f-46ed-8242-c58ea10b5dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2110676088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfa37f2-e247-4257-a432-cde500aa23ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:44Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167390ad-4ea9-4dec-aeb0-ce59406cb250) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167390ad-4ea9-4dec-aeb0-ce59406cb250) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95965248-0d00-4001-b80f-0653b50f74ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95965248-0d00-4001-b80f-0653b50f74ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dfa37f2-e247-4257-a432-cde500aa23ea', 'volume_name': 'volume-0dfa37f2-e247-4257-a432-cde500aa23ea', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6eeb4c-07b7-4829-826f-e85e59e51898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df6eeb4c-07b7-4829-826f-e85e59e51898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe64744-7710-4707-9f08-91b5ed29d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume 0dfa37f2-e247-4257-a432-cde500aa23ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dfa37f2-e247-4257-a432-cde500aa23ea', 'volume_size': 1} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (724d75d1-8068-4eae-9c34-ce24da4e4ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (271ee64a-915e-4ca9-8f9d-6837b7ad59bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (271ee64a-915e-4ca9-8f9d-6837b7ad59bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000891364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87deaa2-8638-4634-a188-a8d0ae21e5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:44Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbad16f-43e4-4909-afb9-8c345ae48b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (abbad16f-43e4-4909-afb9-8c345ae48b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f3da1d-37ba-4bbe-998c-a6ec873bde49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f3da1d-37ba-4bbe-998c-a6ec873bde49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c87deaa2-8638-4634-a188-a8d0ae21e5e9', 'volume_name': 'volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd9fb15-e875-4449-b1bf-70f61c91dff9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd9fb15-e875-4449-b1bf-70f61c91dff9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:43 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76f2d60-601c-4769-b900-1b379f21e7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:44 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume c87deaa2-8638-4634-a188-a8d0ae21e5e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9', 'volume_size': 1} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-cca933fa-6c82-443d-a8fb-17e9abb05a37-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-cca933fa-6c82-443d-a8fb-17e9abb05a37-delete_volume" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-quobyte-cca933fa-6c82-443d-a8fb-17e9abb05a37" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-cca933fa-6c82-443d-a8fb-17e9abb05a37" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e0331-60bd-43a8-ab1a-45a5508ebb4b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:44 devstack sudo[90309]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 1G" returned: 0 in 0.590s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0075bdd4-f677-4365-a07b-329f3f557334 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:44 devstack sudo[90315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0075bdd4-f677-4365-a07b-329f3f557334 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 Apr 13 11:08:44 devstack sudo[90315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:44 devstack sudo[90314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 Apr 13 11:08:44 devstack sudo[90314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:44 devstack sudo[90315]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0075bdd4-f677-4365-a07b-329f3f557334 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5" returned: 0 in 0.432s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:44 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 is being set with open permissions: ugo+rw Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:44 devstack sudo[90324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 Apr 13 11:08:44 devstack sudo[90324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:44 devstack sudo[90314]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37" returned: 0 in 0.502s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:44 devstack sudo[90326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37 Apr 13 11:08:44 devstack sudo[90326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:44 devstack sudo[90324]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5" returned: 0 in 0.435s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:44 devstack sudo[90326]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cca933fa-6c82-443d-a8fb-17e9abb05a37" returned: 0 in 0.410s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:44 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-cca933fa-6c82-443d-a8fb-17e9abb05a37" released by "delete_volume" :: held 0.935s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:44 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.info Apr 13 11:08:44 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Created reservations ['805d10f6-83a5-48d9-b9db-24ebe06c3dce', '61322478-10ce-461d-a95b-48598953a901', 'b3fa6ca8-e222-4204-b687-0db93c2f772d', 'a8f0dfcd-0fbe-47b8-b36b-8246c4cdb31d'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:45 devstack sudo[90332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:45 devstack sudo[90332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-d32b8bb7-64da-48b5-80e9-1639911f2696-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-d32b8bb7-64da-48b5-80e9-1639911f2696-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-quobyte-d32b8bb7-64da-48b5-80e9-1639911f2696" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-d32b8bb7-64da-48b5-80e9-1639911f2696" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6a9f27-501d-4468-8eab-79dd8de7cfda]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:45 devstack sudo[90334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 Apr 13 11:08:45 devstack sudo[90334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:45 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.info" returned: 0 in 0.478s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:45 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.info is being set with open permissions: ugo+rw Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:45 devstack sudo[90338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.info Apr 13 11:08:45 devstack sudo[90338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:45 devstack sudo[90332]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.443s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Deleted volume successfully. Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-62580f92-6726-42d1-b065-fbaf30c73d5f tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-cca933fa-6c82-443d-a8fb-17e9abb05a37-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:45 devstack sudo[90334]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696" returned: 0 in 0.480s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:45 devstack sudo[90343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696 Apr 13 11:08:45 devstack sudo[90343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:45 devstack sudo[90338]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.info" returned: 0 in 0.433s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.118s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.713s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-789126451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d18bd89-a87e-49ce-8eda-88df692433cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:43Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Creating volume 4d18bd89-a87e-49ce-8eda-88df692433cd {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:45 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:45 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:45 devstack sudo[90346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd 1073741824 Apr 13 11:08:45 devstack sudo[90346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:45 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-40619c2a-7956-4640-9ce0-587735c6ac5c tempest-VolumeDependencyTests-126835413 None] Create snapshot completed successfully Apr 13 11:08:46 devstack sudo[90343]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-d32b8bb7-64da-48b5-80e9-1639911f2696" returned: 0 in 0.419s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-d32b8bb7-64da-48b5-80e9-1639911f2696" released by "delete_volume" :: held 0.919s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Created reservations ['580f1cd7-76af-481d-ba76-724dbc577bed', '3c510185-a314-45ff-93a5-8345a9d787f7', '061db96c-9ddf-400f-83bf-7f1417c111ed', 'c585bb46-d15e-468a-9984-696ef7e38b48'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:46 devstack sudo[90349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:46 devstack sudo[90349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-61cb5c4b-0683-4da9-85c7-82d5ff541096-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-61cb5c4b-0683-4da9-85c7-82d5ff541096-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "cinder-quobyte-61cb5c4b-0683-4da9-85c7-82d5ff541096" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-61cb5c4b-0683-4da9-85c7-82d5ff541096" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4cda6a-3cc4-4f61-9e88-9c55acb3b7db]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:46 devstack sudo[90354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 Apr 13 11:08:46 devstack sudo[90354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:46 devstack sudo[90346]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd 1073741824" returned: 0 in 0.536s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:46 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd Apr 13 11:08:46 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:46 devstack sudo[90349]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.464s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:46 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Deleted volume successfully. Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-afb7223a-34c4-46c3-ad5f-4887404db4eb tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-d32b8bb7-64da-48b5-80e9-1639911f2696-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:46 devstack sudo[90354]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096" returned: 0 in 0.525s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:46 devstack sudo[90363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096 Apr 13 11:08:46 devstack sudo[90363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:46 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd" returned: 0 in 0.428s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.460s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1938761759',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0143b0e9-812e-4a36-9a29-5b324df772a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:43Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Creating volume 0143b0e9-812e-4a36-9a29-5b324df772a7 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:46 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0555bce2-9f72-4782-85fb-5200d70d7ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d18bd89-a87e-49ce-8eda-88df692433cd', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:46 devstack sudo[90365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 1073741824 Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b076a8c5-2175-42df-bfc3-1f9bf65690ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:46 devstack sudo[90365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:46 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume volume-4d18bd89-a87e-49ce-8eda-88df692433cd (4d18bd89-a87e-49ce-8eda-88df692433cd): created successfully Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b076a8c5-2175-42df-bfc3-1f9bf65690ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:46 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (6345fc30-0234-4124-a5bc-456c3ce33da2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:46 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-cd428d63-e121-42c7-bdd5-d5dfc3598a9b tempest-CreateVolumesFromSnapshotTest-566772390 None] Created volume successfully. Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Flow 'volume_create_manager' (09036f50-6fc9-40ae-9674-c087b8fd141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a6f7437-f4c3-48ae-9de4-2bd79e7acd8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a6f7437-f4c3-48ae-9de4-2bd79e7acd8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-15449106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=104b4b5d-2e00-45e5-a9a4-552fad3891e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da680498139410b95c2c99ae7b5c969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fec9fadd-3bc0-4c6c-93de-85add08db2d5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:47Z,use_quota=True,user_id='b744331d94bb4b2c8baa32d39302cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcc25da-f658-4e15-b512-bfff97b085ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffcc25da-f658-4e15-b512-bfff97b085ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108f18ec-82d7-4bd5-9254-e8bf08b6c9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (108f18ec-82d7-4bd5-9254-e8bf08b6c9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '104b4b5d-2e00-45e5-a9a4-552fad3891e4', 'volume_name': 'volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4', 'volume_size': 1, 'snapshot_id': 'fec9fadd-3bc0-4c6c-93de-85add08db2d5'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf69963-deed-407a-956d-4d683c850bdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bf69963-deed-407a-956d-4d683c850bdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d602484-9255-48ed-9e4b-dab8238b6a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:47 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Volume 104b4b5d-2e00-45e5-a9a4-552fad3891e4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4', 'volume_size': 1, 'snapshot_id': 'fec9fadd-3bc0-4c6c-93de-85add08db2d5'} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:47 devstack sudo[90363]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-61cb5c4b-0683-4da9-85c7-82d5ff541096" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-quobyte-61cb5c4b-0683-4da9-85c7-82d5ff541096" released by "delete_volume" :: held 1.024s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Created reservations ['376f5e05-e947-4c81-9645-fd98760c7dbf', '0174c227-098b-45ca-9bdf-c7f79725c935', '91699bcf-fdd7-4d17-863d-b27eb463bb07', 'f6bb81f8-6f0b-4fb3-b813-d5d974af3c49'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:47 devstack sudo[90371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:47 devstack sudo[90371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:47 devstack sudo[90365]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 1073741824" returned: 0 in 0.575s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:47 devstack sudo[90373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 Apr 13 11:08:47 devstack sudo[90373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:47 devstack sudo[90371]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.408s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:47 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Deleted volume successfully. Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-38415749-7046-46fb-abfc-45aef6dae2fe tempest-CreateVolumesFromImageTest-1386700956 None] Lock "cinder-61cb5c4b-0683-4da9-85c7-82d5ff541096-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:47 devstack sudo[90373]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7" returned: 0 in 0.411s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.449s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (645c5c64-7635-4b85-a8cc-40fae013ecfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0143b0e9-812e-4a36-9a29-5b324df772a7', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e3a40a-e611-4934-9ac2-b2700d9a4776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Creating offline snapshot 59d8378b-81ca-48c3-8b57-47c2f5d13cee of volume 7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:08:47 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume volume-0143b0e9-812e-4a36-9a29-5b324df772a7 (0143b0e9-812e-4a36-9a29-5b324df772a7): created successfully Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e3a40a-e611-4934-9ac2-b2700d9a4776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (4b010e3d-323b-4994-a413-c04f32d5f37d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd8a6d8-b8a1-4d1c-bbe3-3de995ffd154]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:47 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:47 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1c026fe7-471e-46e1-87cb-a014ae735dc4 tempest-CreateVolumesFromSnapshotTest-566772390 None] Created volume successfully. Apr 13 11:08:48 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 Apr 13 11:08:48 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:48 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" returned: 0 in 0.503s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:48 devstack sudo[90382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee 1G Apr 13 11:08:48 devstack sudo[90382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:48 devstack sudo[90382]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee 1G" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:48 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:49 devstack sudo[90387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee Apr 13 11:08:49 devstack sudo[90387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:49 devstack sudo[90387]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee" returned: 0 in 0.492s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:49 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee is being set with open permissions: ugo+rw Apr 13 11:08:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:49 devstack sudo[90392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee Apr 13 11:08:49 devstack sudo[90392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:49 devstack sudo[90392]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee" returned: 0 in 0.436s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:49 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:49 devstack sudo[90395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.info Apr 13 11:08:49 devstack sudo[90395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (3d557493-a0b5-42c9-bfdb-758b7456ce95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3203dd80-e244-4d0c-8ac3-dfb460c477e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3203dd80-e244-4d0c-8ac3-dfb460c477e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804965912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5666a9a3-4583-49f3-8657-2f19f8f2fdaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:50Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241ab712-c37e-4807-a31d-16043ac8642b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (241ab712-c37e-4807-a31d-16043ac8642b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b9c9a2-8ba4-44c5-a18b-110ba1e5fc07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6b9c9a2-8ba4-44c5-a18b-110ba1e5fc07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5666a9a3-4583-49f3-8657-2f19f8f2fdaf', 'volume_name': 'volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d018272-8700-4b48-a467-70257f3a1e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d018272-8700-4b48-a467-70257f3a1e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a6f78e-4209-4997-a4d1-b0ed2f4ae7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:50 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume 5666a9a3-4583-49f3-8657-2f19f8f2fdaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf', 'volume_size': 1} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:50 devstack sudo[90395]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.info" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:50 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.info is being set with open permissions: ugo+rw Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:50 devstack sudo[90398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.info Apr 13 11:08:50 devstack sudo[90398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:50 devstack sudo[90398]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.info" returned: 0 in 0.417s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.932s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.265s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2118952351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d7dae95-4f37-4ce1-80a4-2df03969a751,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:43Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Creating volume 4d7dae95-4f37-4ce1-80a4-2df03969a751 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:50 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:50 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:50 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 1073741824 Apr 13 11:08:50 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:50 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4712376e-616c-4070-834e-defd084bb626 tempest-CinderUnicodeTest-1469040465 None] Create snapshot completed successfully Apr 13 11:08:51 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 1073741824" returned: 0 in 0.540s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:51 devstack sudo[90406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 Apr 13 11:08:51 devstack sudo[90406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "cinder-59d8378b-81ca-48c3-8b57-47c2f5d13cee-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-59d8378b-81ca-48c3-8b57-47c2f5d13cee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "cinder-quobyte-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-quobyte-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "cinder-quobyte-59d8378b-81ca-48c3-8b57-47c2f5d13cee" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-quobyte-59d8378b-81ca-48c3-8b57-47c2f5d13cee" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Deleting offline snapshot 59d8378b-81ca-48c3-8b57-47c2f5d13cee of volume 7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] snapshot_file for this snap is: volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd0064e0-6bec-4bdb-92f0-bc6c46742aeb]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:51 devstack sudo[90408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee Apr 13 11:08:51 devstack sudo[90408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:51 devstack sudo[90406]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.139s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2110676088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dfa37f2-e247-4257-a432-cde500aa23ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:44Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Creating volume 0dfa37f2-e247-4257-a432-cde500aa23ea {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:51 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da45b166-3d7b-49d2-b63d-739b9240a4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d7dae95-4f37-4ce1-80a4-2df03969a751', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5b2708-e03f-4df6-8b8d-0fc36e3509c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:51 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea 1073741824 Apr 13 11:08:51 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:51 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 (4d7dae95-4f37-4ce1-80a4-2df03969a751): created successfully Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b5b2708-e03f-4df6-8b8d-0fc36e3509c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:51 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (6cb1114d-f1ef-456e-97d5-286bc6c1ff27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:51 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-1c113704-85fe-4193-9785-b73564081b88 tempest-CreateVolumesFromSnapshotTest-566772390 None] Created volume successfully. Apr 13 11:08:52 devstack sudo[90408]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee" returned: 0 in 0.507s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e921294b-d821-4987-b72f-8896d411004d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:52 devstack sudo[90417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 Apr 13 11:08:52 devstack sudo[90417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:52 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea 1073741824" returned: 0 in 0.590s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:52 devstack sudo[90422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea Apr 13 11:08:52 devstack sudo[90422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:52 devstack sudo[90417]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" returned: 0 in 0.530s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:52 devstack sudo[90427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee Apr 13 11:08:52 devstack sudo[90427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:52 devstack sudo[90422]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.983s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2000891364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c87deaa2-8638-4634-a188-a8d0ae21e5e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb91aec0e90749ba85f9ac197ec67f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:44Z,use_quota=True,user_id='8fdcf0809ab34a639c158cb6f6a571e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Creating volume c87deaa2-8638-4634-a188-a8d0ae21e5e9 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:52 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:52 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe64744-7710-4707-9f08-91b5ed29d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dfa37f2-e247-4257-a432-cde500aa23ea', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8d430f-31d9-48e6-89c7-13002b6bac64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:53 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 1073741824 Apr 13 11:08:53 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:53 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume volume-0dfa37f2-e247-4257-a432-cde500aa23ea (0dfa37f2-e247-4257-a432-cde500aa23ea): created successfully Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd8d430f-31d9-48e6-89c7-13002b6bac64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (067962a7-83c2-497d-a9d8-00c2aa6b6e2a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9759e7b2-13d0-4d3c-a35b-1b8c4802eb37 tempest-CreateVolumesFromSnapshotTest-566772390 None] Created volume successfully. Apr 13 11:08:53 devstack sudo[90427]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee" returned: 0 in 0.481s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:53 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee Apr 13 11:08:53 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:53 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 1073741824" returned: 0 in 0.560s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:53 devstack sudo[90440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 Apr 13 11:08:53 devstack sudo[90440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:53 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5.59d8378b-81ca-48c3-8b57-47c2f5d13cee" returned: 0 in 0.495s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-quobyte-59d8378b-81ca-48c3-8b57-47c2f5d13cee" released by "_delete_snapshot" :: held 2.072s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-quobyte-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" released by "delete_snapshot" :: held 2.085s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Created reservations ['c5d7daed-d5a7-4432-a08c-3246146526a0', '60f2927c-53ae-402f-a10c-4857ba69a821', '9040feab-1721-464a-aabb-256cc2598b5b', '7089f72e-27de-4bd6-a52f-84f9ca32a996'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:53 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Delete snapshot completed successfully. Apr 13 11:08:53 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d669630-94de-4f70-9c5f-cdb290a73cb1 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-59d8378b-81ca-48c3-8b57-47c2f5d13cee-delete_snapshot" released by "delete_snapshot" :: held 2.172s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:54 devstack sudo[90440]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9" returned: 0 in 0.464s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 6.777s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-fec9fadd-3bc0-4c6c-93de-85add08db2d5-104b4b5d-2e00-45e5-a9a4-552fad3891e4" by "_create_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f76f2d60-601c-4769-b900-1b379f21e7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854afae4-a198-49c1-8a65-5cba3f3591c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-fec9fadd-3bc0-4c6c-93de-85add08db2d5-104b4b5d-2e00-45e5-a9a4-552fad3891e4" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Creating volume 104b4b5d-2e00-45e5-a9a4-552fad3891e4 from snapshot fec9fadd-3bc0-4c6c-93de-85add08db2d5 {{(pid=82656) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-104b4b5d-2e00-45e5-a9a4-552fad3891e4" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:54 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Volume volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 (c87deaa2-8638-4634-a188-a8d0ae21e5e9): created successfully Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (854afae4-a198-49c1-8a65-5cba3f3591c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Flow 'volume_create_manager' (724d75d1-8068-4eae-9c34-ce24da4e4ec8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-104b4b5d-2e00-45e5-a9a4-552fad3891e4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] snapshot: fec9fadd-3bc0-4c6c-93de-85add08db2d5, volume: 104b4b5d-2e00-45e5-a9a4-552fad3891e4, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:08:54 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3a653196-0ac5-4970-9d9b-5ce95cb4112b tempest-CreateVolumesFromSnapshotTest-566772390 None] Created volume successfully. Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[492d3acf-771c-4c10-83c6-a53e2591dbd6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:54 devstack sudo[90444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 Apr 13 11:08:54 devstack sudo[90444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:54 devstack sudo[90444]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5" returned: 0 in 0.522s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0075bdd4-f677-4365-a07b-329f3f557334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb1d681b-34db-47b0-8d0f-2ab447ce9fa3]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-c87deaa2-8638-4634-a188-a8d0ae21e5e9-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-c87deaa2-8638-4634-a188-a8d0ae21e5e9-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:54 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 Apr 13 11:08:54 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-quobyte-c87deaa2-8638-4634-a188-a8d0ae21e5e9" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-c87deaa2-8638-4634-a188-a8d0ae21e5e9" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[75520605-f490-49d4-92fc-9ae2fd312c0c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "cinder-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "cinder-quobyte-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:54 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 Apr 13 11:08:54 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-quobyte-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[32096308-47ad-49f8-865f-298fb64d96db]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:54 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:54 devstack sudo[90453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 Apr 13 11:08:54 devstack sudo[90453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:55 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334" returned: 0 in 0.501s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:55 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 Apr 13 11:08:55 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:55 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9" returned: 0 in 0.520s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:55 devstack sudo[90466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9 Apr 13 11:08:55 devstack sudo[90466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:55 devstack sudo[90453]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" returned: 0 in 0.499s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:55 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5 Apr 13 11:08:55 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:55 devstack sudo[90466]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-c87deaa2-8638-4634-a188-a8d0ae21e5e9" returned: 0 in 0.681s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:55 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-c87deaa2-8638-4634-a188-a8d0ae21e5e9" released by "delete_volume" :: held 1.233s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Created reservations ['aa96e74c-7c1a-4e7d-add5-d52b18e8c54c', '10e474a5-1c14-4874-9ee9-ac16c9a7048c', '08398eb5-d40c-4b1b-b9fc-2bb576c73017', '33b6da64-1f61-4c50-a5ac-2db7a1ef9c70'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:56 devstack sudo[90483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:56 devstack sudo[90483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:56 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" returned: 0 in 1.080s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-quobyte-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5" released by "delete_volume" :: held 1.617s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Created reservations ['17e563b0-447a-44b3-b01e-a7aa359c1881', '702e4eeb-fbf3-46de-90a2-597810b6fa03', 'f9760ea3-d5be-4791-b94f-596cf54cd4b0', '3d6806e9-ee39-409b-b6fa-0db6390640cd'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:56 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:56 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:56 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-0dfa37f2-e247-4257-a432-cde500aa23ea-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-0dfa37f2-e247-4257-a432-cde500aa23ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-quobyte-0dfa37f2-e247-4257-a432-cde500aa23ea" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-0dfa37f2-e247-4257-a432-cde500aa23ea" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dad2b1-7dff-482e-9a55-e131904722d6]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "cinder-73fba7bf-35d2-417f-8d59-cf7109c70060-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-73fba7bf-35d2-417f-8d59-cf7109c70060-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:57 devstack sudo[90483]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.123s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:57 devstack sudo[90488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea Apr 13 11:08:57 devstack sudo[90488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:57 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Deleted volume successfully. Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "cinder-quobyte-73fba7bf-35d2-417f-8d59-cf7109c70060" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e8a376e1-0195-4610-b67a-31a421a9d949 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-c87deaa2-8638-4634-a188-a8d0ae21e5e9-delete_volume" released by "delete_volume" :: held 2.640s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-quobyte-73fba7bf-35d2-417f-8d59-cf7109c70060" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[402c5e22-94b9-4603-81cc-99de6e6d4b6d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:57 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4" returned: 0 in 2.226s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ba3e21-7409-476c-8354-e2bff871049a]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:57 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 Apr 13 11:08:57 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:57 devstack sudo[90491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 Apr 13 11:08:57 devstack sudo[90491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:57 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 1.048s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:57 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Deleted volume successfully. Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7068283d-dee3-4b9d-a482-d576e64c9716 tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-7a11e4b5-ffc9-45d4-b4cf-e943a1b7d8d5-delete_volume" released by "delete_volume" :: held 2.862s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:57 devstack sudo[90488]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea" returned: 0 in 0.576s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:57 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea Apr 13 11:08:57 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:57 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060" returned: 0 in 0.516s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:57 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:57 devstack sudo[90505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060 Apr 13 11:08:57 devstack sudo[90505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:58 devstack sudo[90491]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334" returned: 0 in 0.648s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334, size 1024.00 MB, duration 2.23 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:08:58 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Converted 1024.00 MB image at 459.65 MB/s Apr 13 11:08:58 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 is being set with open permissions: ugo+rw Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:58 devstack sudo[90508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 Apr 13 11:08:58 devstack sudo[90508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:58 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0dfa37f2-e247-4257-a432-cde500aa23ea" returned: 0 in 0.441s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-0dfa37f2-e247-4257-a432-cde500aa23ea" released by "delete_volume" :: held 1.054s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Created reservations ['ff8b219d-5639-4d62-9549-697341dba28d', '6cbabb5b-94b8-4b7a-8226-1f6204a7b113', 'cdf04986-ad2a-4178-8737-a1e398ca69d0', '00f17233-ddd3-4b54-8b54-ec7f622b88d8'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:58 devstack sudo[90512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:58 devstack sudo[90512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:58 devstack sudo[90505]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-73fba7bf-35d2-417f-8d59-cf7109c70060" returned: 0 in 0.476s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-quobyte-73fba7bf-35d2-417f-8d59-cf7109c70060" released by "delete_volume" :: held 1.014s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Created reservations ['3cae1dd5-36c7-4ca2-954f-9281e15a5ada', '5f82a36a-6b4f-4b6d-aa6f-9e7cd1ec90ef', '393308d2-0897-4bd7-aa38-703981f132b6', '4d1296bd-a416-4405-bd33-852b0659d08f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:58 devstack sudo[90515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:08:58 devstack sudo[90515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:58 devstack sudo[90508]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4" returned: 0 in 0.457s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-104b4b5d-2e00-45e5-a9a4-552fad3891e4" released by "_copy_volume_from_snapshot" :: held 4.422s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-fec9fadd-3bc0-4c6c-93de-85add08db2d5-104b4b5d-2e00-45e5-a9a4-552fad3891e4" released by "_create_volume_from_snapshot" :: held 4.453s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.479s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.341s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:08:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1804965912',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5666a9a3-4583-49f3-8657-2f19f8f2fdaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:08:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:08:50Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Creating volume 5666a9a3-4583-49f3-8657-2f19f8f2fdaf {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:08:58 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:58 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf 1073741824 Apr 13 11:08:58 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d602484-9255-48ed-9e4b-dab8238b6a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4', 'volume_size': 1, 'snapshot_id': 'fec9fadd-3bc0-4c6c-93de-85add08db2d5'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0349a4c9-0078-488d-951f-4d0c7fb5854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:58 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Volume volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 (104b4b5d-2e00-45e5-a9a4-552fad3891e4): created successfully Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0349a4c9-0078-488d-951f-4d0c7fb5854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Flow 'volume_create_manager' (09036f50-6fc9-40ae-9674-c087b8fd141b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:58 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9534e14f-6d0e-49b4-a4ee-decb7558fd98 tempest-VolumeDependencyTests-126835413 None] Created volume successfully. Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-fec9fadd-3bc0-4c6c-93de-85add08db2d5-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Lock "cinder-fec9fadd-3bc0-4c6c-93de-85add08db2d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-0075bdd4-f677-4365-a07b-329f3f557334" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-0075bdd4-f677-4365-a07b-329f3f557334" acquired by "delete_snapshot" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-fec9fadd-3bc0-4c6c-93de-85add08db2d5" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-fec9fadd-3bc0-4c6c-93de-85add08db2d5" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Deleting offline snapshot fec9fadd-3bc0-4c6c-93de-85add08db2d5 of volume 0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] snapshot_file for this snap is: volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4868017-adc8-4de7-963d-997d7a15be61]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:58 devstack sudo[90512]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.547s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:58 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Deleted volume successfully. Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-5b6254b0-1981-46a9-aff1-0d6f40549756 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-0dfa37f2-e247-4257-a432-cde500aa23ea-delete_volume" released by "delete_volume" :: held 1.785s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:58 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 Apr 13 11:08:58 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:58 devstack sudo[90515]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.486s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:08:58 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Deleted volume successfully. Apr 13 11:08:58 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e1e7a8d5-4f5c-4fea-b5b3-9a41b1d99d1f tempest-CinderUnicodeTest-1469040465 None] Lock "cinder-73fba7bf-35d2-417f-8d59-cf7109c70060-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:08:59 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf 1073741824" returned: 0 in 0.524s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:59 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf Apr 13 11:08:59 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-4d7dae95-4f37-4ce1-80a4-2df03969a751-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-4d7dae95-4f37-4ce1-80a4-2df03969a751-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-quobyte-4d7dae95-4f37-4ce1-80a4-2df03969a751" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-4d7dae95-4f37-4ce1-80a4-2df03969a751" acquired by "delete_volume" :: waited 0.017s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[758bc3bf-4996-418e-aa4a-b9d45f870abd]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:59 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5" returned: 0 in 0.552s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0075bdd4-f677-4365-a07b-329f3f557334(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[992a65a2-0f93-499f-92e1-ec29337d548f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:59 devstack sudo[90531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 Apr 13 11:08:59 devstack sudo[90531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:59 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 Apr 13 11:08:59 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:59 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.027s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a6f78e-4209-4997-a4d1-b0ed2f4ae7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e34d5cf-903c-4fcb-84e0-59eb53226a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:08:59 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf (5666a9a3-4583-49f3-8657-2f19f8f2fdaf): created successfully Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e34d5cf-903c-4fcb-84e0-59eb53226a6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (3d557493-a0b5-42c9-bfdb-758b7456ce95) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:08:59 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-ade5c3fe-32c9-45e9-ab6e-6e341b51ddc8 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created volume successfully. Apr 13 11:08:59 devstack sudo[90531]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751" returned: 0 in 0.583s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:59 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334" returned: 0 in 0.559s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:08:59 devstack sudo[90542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751 Apr 13 11:08:59 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:08:59 devstack sudo[90542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:08:59 devstack sudo[90544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 Apr 13 11:08:59 devstack sudo[90544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:00 devstack sudo[90542]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d7dae95-4f37-4ce1-80a4-2df03969a751" returned: 0 in 0.503s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-4d7dae95-4f37-4ce1-80a4-2df03969a751" released by "delete_volume" :: held 1.109s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Created reservations ['ea9616fb-5b5d-4f45-bf68-a435f013a766', '82accdb2-eb3e-4265-b8c4-89ca8d501fea', 'b66e85ce-7b4b-4914-9b80-95368ab76135', '49c84a89-231d-450a-89e6-2efcb2fd0bea'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:00 devstack sudo[90544]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5" returned: 0 in 0.545s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:00 devstack sudo[90550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5 Apr 13 11:09:00 devstack sudo[90550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:00 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:00 devstack sudo[90552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:00 devstack sudo[90552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:01 devstack sudo[90552]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.456s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:01 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Deleted volume successfully. Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e2251973-306f-4a44-9c0d-7e65795d1c0c tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-4d7dae95-4f37-4ce1-80a4-2df03969a751-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:01 devstack sudo[90550]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334.fec9fadd-3bc0-4c6c-93de-85add08db2d5" returned: 0 in 0.558s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (0a4f9598-4185-42c0-a2e1-e81c7639e2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8c0d38-e287-4145-88d1-27dc06ba8a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-fec9fadd-3bc0-4c6c-93de-85add08db2d5" released by "_delete_snapshot" :: held 2.333s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-0075bdd4-f677-4365-a07b-329f3f557334" released by "delete_snapshot" :: held 2.354s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d8c0d38-e287-4145-88d1-27dc06ba8a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956601436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe30e5d4-d081-4546-9087-713c028b5bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:01Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f00bb74-d16d-4782-b739-17a4e3a96403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f00bb74-d16d-4782-b739-17a4e3a96403) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23dcee2-9925-4620-b503-5ec9970e2b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b23dcee2-9925-4620-b503-5ec9970e2b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe30e5d4-d081-4546-9087-713c028b5bc6', 'volume_name': 'volume-fe30e5d4-d081-4546-9087-713c028b5bc6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dde8c6-1c89-4b76-89c8-9e71105fab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54dde8c6-1c89-4b76-89c8-9e71105fab83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093fbb64-afef-4640-938f-9e41fb76b6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume fe30e5d4-d081-4546-9087-713c028b5bc6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe30e5d4-d081-4546-9087-713c028b5bc6', 'volume_size': 1} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956601436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe30e5d4-d081-4546-9087-713c028b5bc6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:01Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Creating volume fe30e5d4-d081-4546-9087-713c028b5bc6 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:09:01 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:01 devstack sudo[90556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 1073741824 Apr 13 11:09:01 devstack sudo[90556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (662d61c5-3c78-4d6a-b289-a5b02b3b4a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660be5e1-1273-49dc-8445-a01c513042c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (660be5e1-1273-49dc-8445-a01c513042c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2024258874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c9280a-0052-4a84-b454-49c7275a4de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:01Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c00c523-15de-49d3-9412-cd7b47456704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c00c523-15de-49d3-9412-cd7b47456704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e5dfe8-a87e-49a9-894c-5465552224b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e5dfe8-a87e-49a9-894c-5465552224b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67c9280a-0052-4a84-b454-49c7275a4de5', 'volume_name': 'volume-67c9280a-0052-4a84-b454-49c7275a4de5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7899f1f-0f9e-4f7a-99df-e84553ad21ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7899f1f-0f9e-4f7a-99df-e84553ad21ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970305f0-04dd-4715-8228-153c2e22dd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume 67c9280a-0052-4a84-b454-49c7275a4de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67c9280a-0052-4a84-b454-49c7275a4de5', 'volume_size': 1} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Created reservations ['c4bfedc2-6548-4abe-9b66-092e856a730f', '685e1ec7-8cf1-413f-8d1f-4b6e77a1bc63', '13c3cde4-ebcb-4756-b01c-5d36e1a54543', 'd48138df-2600-42b9-aee4-08f2d9ef2279'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:01 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Delete snapshot completed successfully. Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e6f0d23e-e038-49cd-9a4f-cf56f153c9ba tempest-VolumeDependencyTests-126835413 None] Lock "cinder-fec9fadd-3bc0-4c6c-93de-85add08db2d5-delete_snapshot" released by "delete_snapshot" :: held 2.598s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (aa43ffb2-3af0-4582-a8aa-9d2f9670f386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6957e3a8-d1ca-4f07-acd0-c1b792fed05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6957e3a8-d1ca-4f07-acd0-c1b792fed05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022733035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0267c0b2-0d03-445e-99da-6f06b54d3cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:01Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2392961-36f9-4ad9-8f6b-d8c52c1cc16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2392961-36f9-4ad9-8f6b-d8c52c1cc16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2c7fe2-adef-4f9b-b704-26dd5a1a6e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2c7fe2-adef-4f9b-b704-26dd5a1a6e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0267c0b2-0d03-445e-99da-6f06b54d3cf3', 'volume_name': 'volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3a3b0c-844f-4d3c-9321-a979d9d82b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e3a3b0c-844f-4d3c-9321-a979d9d82b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46510c05-b10b-4aaa-87eb-3b20e9dfabd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume 0267c0b2-0d03-445e-99da-6f06b54d3cf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3', 'volume_size': 1} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-0143b0e9-812e-4a36-9a29-5b324df772a7-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-0143b0e9-812e-4a36-9a29-5b324df772a7-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-quobyte-0143b0e9-812e-4a36-9a29-5b324df772a7" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-0143b0e9-812e-4a36-9a29-5b324df772a7" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b31aef-897c-463f-aa56-4a74bc589dab]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:01 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 Apr 13 11:09:01 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (930452f8-77d8-4061-8727-0060735fed09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99c7c3d-bfa6-468e-b574-6863d308399b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a99c7c3d-bfa6-468e-b574-6863d308399b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-435429375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb198104-b6cf-481b-a90c-471a40d27e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:02Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c9170a-22e4-4796-9afb-19b52d952132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90c9170a-22e4-4796-9afb-19b52d952132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fc912d-cdf3-4bc1-8f91-ba2717854e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1fc912d-cdf3-4bc1-8f91-ba2717854e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb198104-b6cf-481b-a90c-471a40d27e16', 'volume_name': 'volume-bb198104-b6cf-481b-a90c-471a40d27e16', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c239b1f-4ca6-4056-b967-7009e9af859b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c239b1f-4ca6-4056-b967-7009e9af859b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2324640-180c-4c77-8093-02a8d8c29baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume bb198104-b6cf-481b-a90c-471a40d27e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb198104-b6cf-481b-a90c-471a40d27e16', 'volume_size': 1} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (3e359158-e1a3-4986-817c-de0736f87a76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9795e4fa-5c6d-43b0-9946-70634e3cce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:01 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-0075bdd4-f677-4365-a07b-329f3f557334-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9795e4fa-5c6d-43b0-9946-70634e3cce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1334523003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827a90cb-c8dc-4a1f-9c50-46eb81f71533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:02Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6f72c3-567f-4add-b926-1f6491209589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e6f72c3-567f-4add-b926-1f6491209589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3634da-57e3-4ca6-87e0-47393ebbce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b3634da-57e3-4ca6-87e0-47393ebbce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '827a90cb-c8dc-4a1f-9c50-46eb81f71533', 'volume_name': 'volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3223c128-9531-45c8-a415-ec4d88b82ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:02 devstack sudo[90556]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3223c128-9531-45c8-a415-ec4d88b82ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3e6be1-bab8-407e-b5c8-f8ec14dd416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:02 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume 827a90cb-c8dc-4a1f-9c50-46eb81f71533: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533', 'volume_size': 1} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 1073741824" returned: 0 in 0.905s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Lock "cinder-0075bdd4-f677-4365-a07b-329f3f557334-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-0075bdd4-f677-4365-a07b-329f3f557334" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-0075bdd4-f677-4365-a07b-329f3f557334" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:02 devstack sudo[90564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b061c8-c035-4e88-8c5f-db9df301cb3f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:02 devstack sudo[90564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:02 devstack sudo[90566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 Apr 13 11:09:02 devstack sudo[90566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:02 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7" returned: 0 in 0.698s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:02 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7 Apr 13 11:09:02 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:02 devstack sudo[90564]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6" returned: 0 in 0.516s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] <== create_volume: return (1454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.334s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2024258874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67c9280a-0052-4a84-b454-49c7275a4de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:01Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Creating volume 67c9280a-0052-4a84-b454-49c7275a4de5 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:09:02 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:02 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 1073741824 Apr 13 11:09:02 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (093fbb64-afef-4640-938f-9e41fb76b6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe30e5d4-d081-4546-9087-713c028b5bc6', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95bb3f8-266f-4ec5-822f-99f44c1693c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:02 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume volume-fe30e5d4-d081-4546-9087-713c028b5bc6 (fe30e5d4-d081-4546-9087-713c028b5bc6): created successfully Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d95bb3f8-266f-4ec5-822f-99f44c1693c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (0a4f9598-4185-42c0-a2e1-e81c7639e2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:02 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6a3fdf10-4981-4efd-9471-ee93bb5cc16f tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created volume successfully. Apr 13 11:09:02 devstack sudo[90566]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334" returned: 0 in 0.585s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:02 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0143b0e9-812e-4a36-9a29-5b324df772a7" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:02 devstack sudo[90580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334 Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-0143b0e9-812e-4a36-9a29-5b324df772a7" released by "delete_volume" :: held 1.199s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:02 devstack sudo[90580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Created reservations ['308bab57-53c7-488b-8c7d-abba82c14e2a', '0f61d389-f35b-4645-a524-f479a0ff09f7', 'ec9d3288-5116-4a59-82e5-59aa99c2d495', '6ccd4287-89db-4ce8-b977-6a5509621d00'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:02 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:02 devstack sudo[90582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:02 devstack sudo[90582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:03 devstack sudo[90580]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0075bdd4-f677-4365-a07b-329f3f557334" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-0075bdd4-f677-4365-a07b-329f3f557334" released by "delete_volume" :: held 1.084s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Created reservations ['6d33ce6b-ae2a-4ac6-bc30-2310df6f9c00', '509f0091-6d02-49d1-b2d2-43bcd35cc9dd', 'c7b685d0-950e-4849-a82e-b82d1a0fe17d', '264d86cf-b125-492b-99f9-d4a67278e63a'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:03 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 1073741824" returned: 0 in 0.652s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:03 devstack sudo[90588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:03 devstack sudo[90588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:03 devstack sudo[90591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 Apr 13 11:09:03 devstack sudo[90591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:03 devstack sudo[90582]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.558s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Deleted volume successfully. Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-85656e7a-7155-406b-bee8-04429ae8fafb tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-0143b0e9-812e-4a36-9a29-5b324df772a7-delete_volume" released by "delete_volume" :: held 1.931s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-4d18bd89-a87e-49ce-8eda-88df692433cd-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-4d18bd89-a87e-49ce-8eda-88df692433cd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:03 devstack sudo[90588]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-quobyte-4d18bd89-a87e-49ce-8eda-88df692433cd" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.472s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-4d18bd89-a87e-49ce-8eda-88df692433cd" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Deleted volume successfully. Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0eb1ebb-1e13-4982-9b6c-629d6ede52c0]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:03 devstack sudo[90591]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5" returned: 0 in 0.475s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1022733035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0267c0b2-0d03-445e-99da-6f06b54d3cf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:01Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Creating volume 0267c0b2-0d03-445e-99da-6f06b54d3cf3 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:09:03 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-f58571b4-987c-4b12-86c5-47b9f1342cfe tempest-VolumeDependencyTests-126835413 None] Lock "cinder-0075bdd4-f677-4365-a07b-329f3f557334-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:03 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 1073741824 Apr 13 11:09:03 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (970305f0-04dd-4715-8228-153c2e22dd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67c9280a-0052-4a84-b454-49c7275a4de5', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2f258d-8141-4e88-af3d-53a4c2b08a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:03 devstack sudo[90595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd Apr 13 11:09:03 devstack sudo[90595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:03 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume volume-67c9280a-0052-4a84-b454-49c7275a4de5 (67c9280a-0052-4a84-b454-49c7275a4de5): created successfully Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a2f258d-8141-4e88-af3d-53a4c2b08a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:03 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (662d61c5-3c78-4d6a-b289-a5b02b3b4a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:03 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-63b7a57d-4508-4b45-86cc-194b707d3669 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created volume successfully. Apr 13 11:09:04 devstack sudo[90595]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd" returned: 0 in 0.567s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:04 devstack sudo[90605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd Apr 13 11:09:04 devstack sudo[90605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:04 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 1073741824" returned: 0 in 0.675s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:04 devstack sudo[90607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 Apr 13 11:09:04 devstack sudo[90607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Flow 'volume_create_manager' (7cfbad80-45aa-49e2-89ec-8243856a19f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c2b798-4887-4222-8833-21286e184585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4c2b798-4887-4222-8833-21286e184585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1235532534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb80d641-03ee-441b-b126-458a89902759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da680498139410b95c2c99ae7b5c969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:05Z,use_quota=True,user_id='b744331d94bb4b2c8baa32d39302cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419b00d1-0910-4414-9706-69ada25898ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (419b00d1-0910-4414-9706-69ada25898ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e2980e-9031-4387-8113-8e0c8fd0a36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03e2980e-9031-4387-8113-8e0c8fd0a36c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb80d641-03ee-441b-b126-458a89902759', 'volume_name': 'volume-cb80d641-03ee-441b-b126-458a89902759', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45abe45-f49c-409e-a2f0-7e98ad485773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45abe45-f49c-409e-a2f0-7e98ad485773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e714120-26c8-4b13-9bd3-9c1e5cc33eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:04 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Volume cb80d641-03ee-441b-b126-458a89902759: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb80d641-03ee-441b-b126-458a89902759', 'volume_size': 1} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:04 devstack sudo[90605]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-4d18bd89-a87e-49ce-8eda-88df692433cd" returned: 0 in 0.500s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-4d18bd89-a87e-49ce-8eda-88df692433cd" released by "delete_volume" :: held 1.089s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Created reservations ['6981473b-ee55-4fe8-a41c-b2aa06a28e10', '12f67a0a-aa7d-44aa-b68f-8216c50c3bbb', '4368850d-1f64-495c-9137-4d959a837547', 'fb5328e8-a5f6-4d4d-b186-f72b0f5c55e4'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:04 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:04 devstack sudo[90611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:04 devstack sudo[90611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:05 devstack sudo[90607]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3" returned: 0 in 0.475s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.179s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-435429375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb198104-b6cf-481b-a90c-471a40d27e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:02Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Creating volume bb198104-b6cf-481b-a90c-471a40d27e16 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:09:05 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46510c05-b10b-4aaa-87eb-3b20e9dfabd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:05 devstack sudo[90613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 1073741824 Apr 13 11:09:05 devstack sudo[90613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b177204-d2ef-43f5-8ff9-39941bb0cab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:05 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 (0267c0b2-0d03-445e-99da-6f06b54d3cf3): created successfully Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b177204-d2ef-43f5-8ff9-39941bb0cab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (aa43ffb2-3af0-4582-a8aa-9d2f9670f386) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-7431b9a1-1457-4aa8-841f-8ddd4dac1fea tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created volume successfully. Apr 13 11:09:05 devstack sudo[90611]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.635s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:05 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Deleted volume successfully. Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-46bc4f1d-20cb-4941-a55d-549107db435e tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-4d18bd89-a87e-49ce-8eda-88df692433cd-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:05 devstack sudo[90613]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 1073741824" returned: 0 in 0.658s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:05 devstack sudo[90619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 Apr 13 11:09:05 devstack sudo[90619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-4838ba9d-5063-4c1f-a3cf-421072b61934-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-4838ba9d-5063-4c1f-a3cf-421072b61934-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-quobyte-017e7c84-f76f-44c6-9785-dba1e4146439" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-017e7c84-f76f-44c6-9785-dba1e4146439" acquired by "delete_snapshot" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-quobyte-4838ba9d-5063-4c1f-a3cf-421072b61934" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-4838ba9d-5063-4c1f-a3cf-421072b61934" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Deleting offline snapshot 4838ba9d-5063-4c1f-a3cf-421072b61934 of volume 017e7c84-f76f-44c6-9785-dba1e4146439 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] snapshot_file for this snap is: volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbfb13e-d5e5-45d7-925b-ee4d103e130d]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:05 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:06 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 Apr 13 11:09:06 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:06 devstack sudo[90619]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16" returned: 0 in 0.486s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] <== create_volume: return (1170ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.173s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.124s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1334523003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=827a90cb-c8dc-4a1f-9c50-46eb81f71533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b876ead0efbe460e90793384968eac4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:02Z,use_quota=True,user_id='99a2a0968ca84ba69a84cc4da7923f28',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Creating volume 827a90cb-c8dc-4a1f-9c50-46eb81f71533 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:09:06 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2324640-180c-4c77-8093-02a8d8c29baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb198104-b6cf-481b-a90c-471a40d27e16', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1adbb4d-d1e4-4190-a4d4-af1571c7c533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:06 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume volume-bb198104-b6cf-481b-a90c-471a40d27e16 (bb198104-b6cf-481b-a90c-471a40d27e16): created successfully Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1adbb4d-d1e4-4190-a4d4-af1571c7c533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (930452f8-77d8-4061-8727-0060735fed09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:06 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 1073741824 Apr 13 11:09:06 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:06 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-eecd3911-b5e8-45ad-aad4-24e7f43098dc tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created volume successfully. Apr 13 11:09:06 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934" returned: 0 in 0.622s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-017e7c84-f76f-44c6-9785-dba1e4146439(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[027fe5bb-fc40-4e91-a006-1ecb5f49e0ce]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:06 devstack sudo[90629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 Apr 13 11:09:06 devstack sudo[90629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:06 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 1073741824" returned: 0 in 0.628s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:06 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:06 devstack sudo[90634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 Apr 13 11:09:06 devstack sudo[90634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:07 devstack sudo[90629]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439" returned: 0 in 0.595s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:07 devstack sudo[90639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 Apr 13 11:09:07 devstack sudo[90639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:07 devstack sudo[90634]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533" returned: 0 in 0.510s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.734s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1235532534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb80d641-03ee-441b-b126-458a89902759,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da680498139410b95c2c99ae7b5c969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:05Z,use_quota=True,user_id='b744331d94bb4b2c8baa32d39302cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Creating volume cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:09:07 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3e6be1-bab8-407e-b5c8-f8ec14dd416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:07 devstack sudo[90642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 1073741824 Apr 13 11:09:07 devstack sudo[90642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6553c049-d20d-4e30-a487-a1f9a86435e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:07 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Volume volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 (827a90cb-c8dc-4a1f-9c50-46eb81f71533): created successfully Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6553c049-d20d-4e30-a487-a1f9a86435e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Flow 'volume_create_manager' (3e359158-e1a3-4986-817c-de0736f87a76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:07 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-84abaad6-c8e0-49f1-8521-1b11cacf6ac7 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created volume successfully. Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-827a90cb-c8dc-4a1f-9c50-46eb81f71533-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-827a90cb-c8dc-4a1f-9c50-46eb81f71533-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-quobyte-827a90cb-c8dc-4a1f-9c50-46eb81f71533" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-827a90cb-c8dc-4a1f-9c50-46eb81f71533" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37d649f-1e66-4c8f-b3be-55f321b18b2e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:07 devstack sudo[90639]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934" returned: 0 in 0.620s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:07 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:07 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 Apr 13 11:09:07 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:07 devstack sudo[90649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934 Apr 13 11:09:07 devstack sudo[90649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:08 devstack sudo[90642]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 1073741824" returned: 0 in 0.653s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:08 devstack sudo[90655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 Apr 13 11:09:08 devstack sudo[90655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:08 devstack sudo[90649]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439.4838ba9d-5063-4c1f-a3cf-421072b61934" returned: 0 in 0.540s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:08 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-4838ba9d-5063-4c1f-a3cf-421072b61934" released by "_delete_snapshot" :: held 2.432s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533" returned: 0 in 0.646s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-017e7c84-f76f-44c6-9785-dba1e4146439" released by "delete_snapshot" :: held 2.462s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:08 devstack sudo[90661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533 Apr 13 11:09:08 devstack sudo[90661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Created reservations ['b4fc3b96-655e-40a0-b550-1d93eb888bc0', 'fbb648fa-6411-4ee1-85e9-e465ba48f5f1', '2f23d0b5-3a9f-489f-a22d-d8ecd8964874', '6ba11f65-5fb3-4320-be31-c76768dc0335'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:08 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Delete snapshot completed successfully. Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-d90c3d6c-8225-4512-9959-88a146b82fff tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-4838ba9d-5063-4c1f-a3cf-421072b61934-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:08 devstack sudo[90655]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759" returned: 0 in 0.557s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.243s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e714120-26c8-4b13-9bd3-9c1e5cc33eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb80d641-03ee-441b-b126-458a89902759', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67f136f-9185-45ba-bf24-940d4af3264f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:08 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Volume volume-cb80d641-03ee-441b-b126-458a89902759 (cb80d641-03ee-441b-b126-458a89902759): created successfully Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b67f136f-9185-45ba-bf24-940d4af3264f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Flow 'volume_create_manager' (7cfbad80-45aa-49e2-89ec-8243856a19f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:08 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-dd359df3-4e72-4e26-980b-b105afd1a908 tempest-VolumeDependencyTests-126835413 None] Created volume successfully. Apr 13 11:09:08 devstack sudo[90661]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-827a90cb-c8dc-4a1f-9c50-46eb81f71533" returned: 0 in 0.525s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-827a90cb-c8dc-4a1f-9c50-46eb81f71533" released by "delete_volume" :: held 1.205s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:08 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created reservations ['55e855f7-69e3-4c9c-bfd2-d1c43dadaea2', '3b6d76d0-ad24-4f0c-8d0a-3ae9e3c9286c', 'f1196dd0-40ed-49e9-993f-390bce85e4a0', '1ade00ec-8f77-4ef9-bef4-4d3ff98791e9'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:09 devstack sudo[90665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:09 devstack sudo[90665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-017e7c84-f76f-44c6-9785-dba1e4146439-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-017e7c84-f76f-44c6-9785-dba1e4146439-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "cinder-quobyte-017e7c84-f76f-44c6-9785-dba1e4146439" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-017e7c84-f76f-44c6-9785-dba1e4146439" acquired by "delete_volume" :: waited 0.022s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e85741e-e05e-46a2-b1fe-e1b46e2b7257]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:09 devstack sudo[90667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 Apr 13 11:09:09 devstack sudo[90667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Flow 'volume_create_manager' (704dc0c1-1adc-43a3-ad06-125a0df4f3f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5275f1ba-51d7-46cb-89dc-75083e944bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5275f1ba-51d7-46cb-89dc-75083e944bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1953383762',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57f8595f-908b-41e5-ac30-5548352a7e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6da680498139410b95c2c99ae7b5c969',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=cb80d641-03ee-441b-b126-458a89902759,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:09Z,use_quota=True,user_id='b744331d94bb4b2c8baa32d39302cb61',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8799126e-3b79-4644-b86a-53eb414d5727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8799126e-3b79-4644-b86a-53eb414d5727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20cca10-b55d-4220-be20-72e0152110c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c20cca10-b55d-4220-be20-72e0152110c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '57f8595f-908b-41e5-ac30-5548352a7e2a', 'volume_name': 'volume-57f8595f-908b-41e5-ac30-5548352a7e2a', 'volume_size': 1, 'source_volid': 'cb80d641-03ee-441b-b126-458a89902759', 'source_volstatus': 'available'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b402ec22-39ae-41f5-8792-9c22e8491bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b402ec22-39ae-41f5-8792-9c22e8491bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89981c17-99ee-4b02-b8e2-f325c601d359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:09 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Volume 57f8595f-908b-41e5-ac30-5548352a7e2a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-57f8595f-908b-41e5-ac30-5548352a7e2a', 'volume_size': 1, 'source_volid': 'cb80d641-03ee-441b-b126-458a89902759', 'source_volstatus': 'available'} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:09 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Cloning volume cb80d641-03ee-441b-b126-458a89902759 to volume 57f8595f-908b-41e5-ac30-5548352a7e2a Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Creating offline snapshot 81d09cb2-d478-4d51-bb42-384b1ba2bcfd of volume cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[99326d9a-aace-4185-925b-bcd2dd4b6843]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:09 devstack sudo[90669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 Apr 13 11:09:09 devstack sudo[90669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:09 devstack sudo[90665]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.551s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:09 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Deleted volume successfully. Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-a171c46b-1ed6-4291-99ca-b6178f72981b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-827a90cb-c8dc-4a1f-9c50-46eb81f71533-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:09 devstack sudo[90667]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439" returned: 0 in 0.576s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:09 devstack sudo[90675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439 Apr 13 11:09:09 devstack sudo[90675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-bb198104-b6cf-481b-a90c-471a40d27e16-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-bb198104-b6cf-481b-a90c-471a40d27e16-delete_volume" acquired by "delete_volume" :: waited 0.012s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-quobyte-bb198104-b6cf-481b-a90c-471a40d27e16" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-bb198104-b6cf-481b-a90c-471a40d27e16" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba44e951-1506-442c-8ac4-7974b215ef8c]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:09 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:10 devstack sudo[90680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 Apr 13 11:09:10 devstack sudo[90680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:10 devstack sudo[90669]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759" returned: 0 in 0.631s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:10 devstack sudo[90682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd 1G Apr 13 11:09:10 devstack sudo[90682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:10 devstack sudo[90675]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-017e7c84-f76f-44c6-9785-dba1e4146439" returned: 0 in 0.606s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-quobyte-017e7c84-f76f-44c6-9785-dba1e4146439" released by "delete_volume" :: held 1.219s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Created reservations ['412c1275-6725-41d7-8f6a-ead40fbeae63', '644da112-712f-4804-ab34-21308838b9aa', '6abd8576-b3a0-4ade-952d-76fa6616f160', 'bd3b6b7f-2331-47ed-95bc-a1d2ae08ee8b'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:10 devstack sudo[90680]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16" returned: 0 in 0.571s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:10 devstack sudo[90691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16 Apr 13 11:09:10 devstack sudo[90691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:10 devstack sudo[90693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:10 devstack sudo[90693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:10 devstack sudo[90682]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd 1G" returned: 0 in 0.565s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:10 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb80d641-03ee-441b-b126-458a89902759 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:10 devstack sudo[90695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb80d641-03ee-441b-b126-458a89902759 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd Apr 13 11:09:10 devstack sudo[90695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:11 devstack sudo[90691]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-bb198104-b6cf-481b-a90c-471a40d27e16" returned: 0 in 0.533s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-bb198104-b6cf-481b-a90c-471a40d27e16" released by "delete_volume" :: held 1.130s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created reservations ['8cd766da-6a5b-4fc6-afc9-b8778a7cef22', '3d9424c6-d0c7-4ff6-bf88-67a1896968c8', '932f3c75-60ad-4209-9772-bad8f953a28b', 'f3d43c0d-2154-4db1-a230-aee27faf07b0'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:11 devstack sudo[90693]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:11 devstack sudo[90695]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb80d641-03ee-441b-b126-458a89902759 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd" returned: 0 in 0.528s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.585s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:11 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd is being set with open permissions: ugo+rw Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Deleted volume successfully. Apr 13 11:09:11 devstack sudo[90702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd Apr 13 11:09:11 devstack sudo[90702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-e871d012-fc42-4aa7-a772-5c2a2d288c63 tempest-CreateVolumesFromSnapshotTest-566772390 None] Lock "cinder-017e7c84-f76f-44c6-9785-dba1e4146439-delete_volume" released by "delete_volume" :: held 2.074s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:11 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:11 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:11 devstack sudo[90702]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd" returned: 0 in 0.477s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:11 devstack sudo[90707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.info Apr 13 11:09:11 devstack sudo[90707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:11 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.555s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:11 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Deleted volume successfully. Apr 13 11:09:11 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-eefa4905-0b90-49c1-a0e9-05f4be27280b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-bb198104-b6cf-481b-a90c-471a40d27e16-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-0267c0b2-0d03-445e-99da-6f06b54d3cf3-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-0267c0b2-0d03-445e-99da-6f06b54d3cf3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-quobyte-0267c0b2-0d03-445e-99da-6f06b54d3cf3" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-0267c0b2-0d03-445e-99da-6f06b54d3cf3" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1049ab1f-82ae-43d2-ae86-e21e9ee9d5f1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:12 devstack sudo[90712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 Apr 13 11:09:12 devstack sudo[90712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:12 devstack sudo[90707]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.info" returned: 0 in 0.657s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:12 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.info is being set with open permissions: ugo+rw Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:12 devstack sudo[90714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.info Apr 13 11:09:12 devstack sudo[90714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:12 devstack sudo[90714]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.info" returned: 0 in 0.472s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-57f8595f-908b-41e5-ac30-5548352a7e2a" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:12 devstack sudo[90712]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3" returned: 0 in 0.611s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-57f8595f-908b-41e5-ac30-5548352a7e2a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] snapshot: 81d09cb2-d478-4d51-bb42-384b1ba2bcfd, volume: 57f8595f-908b-41e5-ac30-5548352a7e2a, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:12 devstack sudo[90720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3 Apr 13 11:09:12 devstack sudo[90720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f7d11f7-38fb-485b-9110-d5fe5ec263aa]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:12 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:12 devstack sudo[90722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd Apr 13 11:09:12 devstack sudo[90722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:13 devstack sudo[90720]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-0267c0b2-0d03-445e-99da-6f06b54d3cf3" returned: 0 in 0.512s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-0267c0b2-0d03-445e-99da-6f06b54d3cf3" released by "delete_volume" :: held 1.165s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:13 devstack sudo[90722]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd" returned: 0 in 0.550s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb80d641-03ee-441b-b126-458a89902759(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created reservations ['f45a77ca-95f5-4687-9179-817085fd3ccc', 'a0d4d809-c89c-40da-9a31-38d7e119d61d', '0c6c51db-a00e-40e1-a02a-6fed2b2db38d', 'e182924f-ffb5-4798-8984-b4117619b914'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5408ed8-d023-4c49-a0aa-b662b67eb7fc]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:13 devstack sudo[90728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:13 devstack sudo[90728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:13 devstack sudo[90730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:13 devstack sudo[90730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:13 devstack sudo[90728]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759" returned: 0 in 0.538s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:13 devstack sudo[90730]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.489s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:13 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:13 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Deleted volume successfully. Apr 13 11:09:13 devstack sudo[90736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a Apr 13 11:09:13 devstack sudo[90736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-cbd2f77a-1bd9-4879-9222-5656a94bf7e4 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-0267c0b2-0d03-445e-99da-6f06b54d3cf3-delete_volume" released by "delete_volume" :: held 1.923s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-67c9280a-0052-4a84-b454-49c7275a4de5-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-67c9280a-0052-4a84-b454-49c7275a4de5-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-quobyte-67c9280a-0052-4a84-b454-49c7275a4de5" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:14 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-67c9280a-0052-4a84-b454-49c7275a4de5" acquired by "delete_volume" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:14 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42fac8b-0137-4b9f-aae4-73028b8e6152]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:14 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:14 devstack sudo[90738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 Apr 13 11:09:14 devstack sudo[90738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:15 devstack sudo[90738]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5" returned: 0 in 1.363s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:15 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:15 devstack sudo[90753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5 Apr 13 11:09:15 devstack sudo[90753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:16 devstack sudo[90736]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a" returned: 0 in 2.640s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf94f7b5-cbda-4fff-bdd2-eb2f29c597fe]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:16 devstack sudo[90753]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-67c9280a-0052-4a84-b454-49c7275a4de5" returned: 0 in 0.880s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-67c9280a-0052-4a84-b454-49c7275a4de5" released by "delete_volume" :: held 2.269s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created reservations ['115a97b6-e7cb-4437-b8e7-66010f3d6900', '757b1067-ac08-476a-9f8a-0ef7d4ba8e2d', '85bb3d99-cd80-43e8-8722-683a620323e4', '8f8eae21-a32e-403c-87bd-b86ca38e30b0'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:16 devstack sudo[90756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 Apr 13 11:09:16 devstack sudo[90756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:16 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:16 devstack sudo[90758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:16 devstack sudo[90758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:17 devstack sudo[90758]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.465s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:17 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Deleted volume successfully. Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-9244b961-517c-4134-9471-8a5199526c2b tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-67c9280a-0052-4a84-b454-49c7275a4de5-delete_volume" released by "delete_volume" :: held 2.874s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:17 devstack sudo[90756]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759" returned: 0 in 0.735s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759, size 1024.00 MB, duration 2.64 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:09:17 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Converted 1024.00 MB image at 387.75 MB/s Apr 13 11:09:17 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a is being set with open permissions: ugo+rw Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:17 devstack sudo[90764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a Apr 13 11:09:17 devstack sudo[90764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-fe30e5d4-d081-4546-9087-713c028b5bc6-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-fe30e5d4-d081-4546-9087-713c028b5bc6-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-quobyte-fe30e5d4-d081-4546-9087-713c028b5bc6" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-fe30e5d4-d081-4546-9087-713c028b5bc6" acquired by "delete_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0511fc-1dc9-4480-aafc-87f0b4d84267]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:17 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 Apr 13 11:09:17 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:17 devstack sudo[90764]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a" returned: 0 in 0.497s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-57f8595f-908b-41e5-ac30-5548352a7e2a" released by "_copy_volume_from_snapshot" :: held 5.016s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-81d09cb2-d478-4d51-bb42-384b1ba2bcfd" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-81d09cb2-d478-4d51-bb42-384b1ba2bcfd" acquired by "_delete_snapshot" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Deleting offline snapshot 81d09cb2-d478-4d51-bb42-384b1ba2bcfd of volume cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] snapshot_file for this snap is: volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e6c200-a4fc-4b3b-a080-5f0f367b7f2e]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:17 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:17 devstack sudo[90769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd Apr 13 11:09:17 devstack sudo[90769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:18 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6" returned: 0 in 0.561s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:18 devstack sudo[90774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6 Apr 13 11:09:18 devstack sudo[90774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:18 devstack sudo[90769]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd" returned: 0 in 0.608s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb80d641-03ee-441b-b126-458a89902759(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e0d60a-ef5b-4731-830c-7973d81d1cbc]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:18 devstack sudo[90779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 Apr 13 11:09:18 devstack sudo[90779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:18 devstack sudo[90774]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-fe30e5d4-d081-4546-9087-713c028b5bc6" returned: 0 in 0.470s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-fe30e5d4-d081-4546-9087-713c028b5bc6" released by "delete_volume" :: held 1.054s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created reservations ['fe86a54e-684b-4522-8c2d-292b80bc883e', '2f909522-7285-4331-bd95-7e4b4214d327', '614417d2-6083-4803-b39d-97315ce620ff', '5a9b9f64-3436-4271-9eb3-6f427c159fb1'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:18 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:18 devstack sudo[90783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:18 devstack sudo[90783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:19 devstack sudo[90779]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759" returned: 0 in 0.552s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:19 devstack sudo[90788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd Apr 13 11:09:19 devstack sudo[90788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:19 devstack sudo[90783]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.440s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:19 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Deleted volume successfully. Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-91c23416-46ed-4a8a-87db-e53f70218930 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-fe30e5d4-d081-4546-9087-713c028b5bc6-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:19 devstack sudo[90788]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd" returned: 0 in 0.487s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:19 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd Apr 13 11:09:19 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-5666a9a3-4583-49f3-8657-2f19f8f2fdaf-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-5666a9a3-4583-49f3-8657-2f19f8f2fdaf-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "cinder-quobyte-5666a9a3-4583-49f3-8657-2f19f8f2fdaf" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-5666a9a3-4583-49f3-8657-2f19f8f2fdaf" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a649433-af92-4d73-830d-4ef4fa69d81a]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:19 devstack sudo[90796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf Apr 13 11:09:19 devstack sudo[90796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:19 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:19 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759.81d09cb2-d478-4d51-bb42-384b1ba2bcfd" returned: 0 in 0.456s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-81d09cb2-d478-4d51-bb42-384b1ba2bcfd" released by "_delete_snapshot" :: held 2.155s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.627s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89981c17-99ee-4b02-b8e2-f325c601d359) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57f8595f-908b-41e5-ac30-5548352a7e2a', 'volume_size': 1, 'source_volid': 'cb80d641-03ee-441b-b126-458a89902759', 'source_volstatus': 'available'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f665eaee-7bec-4723-aac4-4d911cbd95de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:20 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Volume volume-57f8595f-908b-41e5-ac30-5548352a7e2a (57f8595f-908b-41e5-ac30-5548352a7e2a): created successfully Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f665eaee-7bec-4723-aac4-4d911cbd95de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Flow 'volume_create_manager' (704dc0c1-1adc-43a3-ad06-125a0df4f3f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:20 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-4e9db79b-4186-45b7-a364-82f85e534505 tempest-VolumeDependencyTests-126835413 None] Created volume successfully. Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Flow 'volume_create_manager' (0df20db2-150a-4197-a088-65ced78326f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66aad141-0613-48f6-817d-9c642b6a8edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66aad141-0613-48f6-817d-9c642b6a8edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1120259183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fd8b18-4eb8-498f-b949-30f5c16d0996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96da3dc7bdbb42aab291aefb42b27aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:20Z,use_quota=True,user_id='14f3b5e46a414c089c3eda59031a4396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:20 devstack sudo[90796]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971d5a39-4184-4a1d-aee6-3bbd2547afd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971d5a39-4184-4a1d-aee6-3bbd2547afd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c1bee7-688e-45de-bf5d-fc79aadb0c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67c1bee7-688e-45de-bf5d-fc79aadb0c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4fd8b18-4eb8-498f-b949-30f5c16d0996', 'volume_name': 'volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c8dde9-a04d-4b04-b1f8-699638e4e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14c8dde9-a04d-4b04-b1f8-699638e4e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af22cff-35e6-47e2-b361-28d5e5012088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:20 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Volume b4fd8b18-4eb8-498f-b949-30f5c16d0996: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996', 'volume_size': 1} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1120259183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fd8b18-4eb8-498f-b949-30f5c16d0996,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96da3dc7bdbb42aab291aefb42b27aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:20Z,use_quota=True,user_id='14f3b5e46a414c089c3eda59031a4396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)}" {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1498}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Creating volume b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:09:20 devstack cinder-volume[82656]: INFO cinder.volume.drivers.remotefs [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] casted to osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 1073741824 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf" returned: 0 in 0.564s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:20 devstack sudo[90802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 1073741824 Apr 13 11:09:20 devstack sudo[90802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:20 devstack sudo[90803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf Apr 13 11:09:20 devstack sudo[90803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:20 devstack sudo[90803]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-5666a9a3-4583-49f3-8657-2f19f8f2fdaf" returned: 0 in 0.418s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-quobyte-5666a9a3-4583-49f3-8657-2f19f8f2fdaf" released by "delete_volume" :: held 1.009s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:20 devstack sudo[90802]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 1073741824" returned: 0 in 0.471s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Created reservations ['319728e2-a15d-4867-87f3-7891643d1dd3', '85bf2280-8c21-44fb-a0ed-27afc66e687f', 'df242e2c-15f3-47be-a321-145c0100bf7f', 'c97c25b9-7651-44fd-8568-3880d7e5b198'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:20 devstack sudo[90810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 Apr 13 11:09:20 devstack sudo[90810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:20 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:21 devstack sudo[90812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:21 devstack sudo[90812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-cb80d641-03ee-441b-b126-458a89902759-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-cb80d641-03ee-441b-b126-458a89902759-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-cb80d641-03ee-441b-b126-458a89902759" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-cb80d641-03ee-441b-b126-458a89902759" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f1dd42-9259-42f7-b047-61d0d003c3f8]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:21 devstack sudo[90814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 Apr 13 11:09:21 devstack sudo[90814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:21 devstack sudo[90810]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996" returned: 0 in 0.443s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'} {{(pid=82656) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1523}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2af22cff-35e6-47e2-b361-28d5e5012088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996', 'volume_size': 1}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045549a6-33e0-455f-a68a-6e9eb6b486a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:21 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Volume volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 (b4fd8b18-4eb8-498f-b949-30f5c16d0996): created successfully Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (045549a6-33e0-455f-a68a-6e9eb6b486a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Flow 'volume_create_manager' (0df20db2-150a-4197-a088-65ced78326f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:21 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-6c0f0c92-a5da-42a2-872a-e162e394aba8 tempest-SnapshotDependencyTests-1014945050 None] Created volume successfully. Apr 13 11:09:21 devstack sudo[90812]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.472s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:21 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Deleted volume successfully. Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2a4f8b57-ef7b-47f1-bbf7-5b97398e8b05 tempest-CreateVolumesFromSourceVolumeTest-1001233612 None] Lock "cinder-5666a9a3-4583-49f3-8657-2f19f8f2fdaf-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:21 devstack sudo[90814]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759" returned: 0 in 0.488s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:21 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:21 devstack sudo[90827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759 Apr 13 11:09:21 devstack sudo[90827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:22 devstack sudo[90827]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-cb80d641-03ee-441b-b126-458a89902759" returned: 0 in 0.431s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-cb80d641-03ee-441b-b126-458a89902759" released by "delete_volume" :: held 0.950s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Created reservations ['75f32423-86ea-458d-9a80-99e720a35516', 'd35c26a3-21e7-4bd7-85fe-37a6f8257bad', '902ccd8a-56a9-4dbf-bd78-fe88f8561dcd', '89d5a050-e093-4ecc-b75d-79a305903428'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:22 devstack sudo[90831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:22 devstack sudo[90831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-57f8595f-908b-41e5-ac30-5548352a7e2a-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-57f8595f-908b-41e5-ac30-5548352a7e2a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-57f8595f-908b-41e5-ac30-5548352a7e2a" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-57f8595f-908b-41e5-ac30-5548352a7e2a" acquired by "delete_volume" :: waited 0.018s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf6f0a1-07cc-41b1-b811-62f536c61b6a]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:22 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a Apr 13 11:09:22 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Creating offline snapshot 98e3d400-2d41-48c7-87ea-3ac185dfd04a of volume b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1815}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f4b3be2-b0c5-42ea-b290-28463eca2c5f]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:22 devstack sudo[90831]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.547s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:22 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Deleted volume successfully. Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-2d50b2f3-9bb1-4102-9025-efc5eca08194 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-cb80d641-03ee-441b-b126-458a89902759-delete_volume" released by "delete_volume" :: held 1.678s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:22 devstack sudo[90836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 Apr 13 11:09:22 devstack sudo[90836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:22 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a" returned: 0 in 0.609s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:22 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:22 devstack sudo[90841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a Apr 13 11:09:22 devstack sudo[90841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:23 devstack sudo[90836]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996" returned: 0 in 0.579s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a 1G {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:23 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a 1G Apr 13 11:09:23 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:23 devstack sudo[90841]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-57f8595f-908b-41e5-ac30-5548352a7e2a" returned: 0 in 0.466s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-57f8595f-908b-41e5-ac30-5548352a7e2a" released by "delete_volume" :: held 1.100s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Created reservations ['24e2a1e4-b7c2-48db-a444-350f9b1f5d1f', '83db2471-1a4f-4abc-9d96-d8873a0516fe', '68792dc1-bba3-4949-9de4-ea43354334a2', '00aca606-cdbd-47f5-ba70-4f64d4f9e35e'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:23 devstack sudo[90849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:23 devstack sudo[90849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:23 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a 1G" returned: 0 in 0.495s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:23 devstack sudo[90854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a Apr 13 11:09:23 devstack sudo[90854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:23 devstack sudo[90849]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.424s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:23 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Deleted volume successfully. Apr 13 11:09:23 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-7fee3eb2-6d5d-4671-b619-363285b073c5 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-57f8595f-908b-41e5-ac30-5548352a7e2a-delete_volume" released by "delete_volume" :: held 1.661s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:24 devstack sudo[90854]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 -F qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a" returned: 0 in 0.425s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:24 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a is being set with open permissions: ugo+rw Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:24 devstack sudo[90860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a Apr 13 11:09:24 devstack sudo[90860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-104b4b5d-2e00-45e5-a9a4-552fad3891e4-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-104b4b5d-2e00-45e5-a9a4-552fad3891e4-delete_volume" acquired by "delete_volume" :: waited 0.008s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "cinder-quobyte-104b4b5d-2e00-45e5-a9a4-552fad3891e4" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-104b4b5d-2e00-45e5-a9a4-552fad3891e4" acquired by "delete_volume" :: waited 0.022s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84e4b8e-4e77-4cf8-af75-79fb4d62ec53]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:24 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 Apr 13 11:09:24 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:24 devstack sudo[90860]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a" returned: 0 in 0.425s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:24 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:24 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.info Apr 13 11:09:24 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:25 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4" returned: 0 in 0.522s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:25 devstack sudo[90871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4 Apr 13 11:09:25 devstack sudo[90871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:25 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.info" returned: 0 in 0.478s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:25 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.info is being set with open permissions: ugo+rw Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.info {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:25 devstack sudo[90873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.info Apr 13 11:09:25 devstack sudo[90873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:25 devstack sudo[90871]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-104b4b5d-2e00-45e5-a9a4-552fad3891e4" returned: 0 in 0.429s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-quobyte-104b4b5d-2e00-45e5-a9a4-552fad3891e4" released by "delete_volume" :: held 0.976s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Created reservations ['9b9f6981-e017-4494-ad0e-54e453980aec', '6e11dad8-3576-471b-9dcd-2a2d16ca425e', '9c39454c-2431-4eba-aec5-f16be7193bd7', 'e8fdfc8d-55b7-4613-8090-1be1911b369f'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:25 devstack sudo[90873]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.info" returned: 0 in 0.436s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:25 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:25 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.896s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:25 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:25 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-3c3c6ea6-2e1f-4841-a93f-a6216b421663 tempest-SnapshotDependencyTests-1014945050 None] Create snapshot completed successfully Apr 13 11:09:26 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.424s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:26 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Deleted volume successfully. Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-b6ce5e03-518d-40e5-ad86-bb33aaf054d3 tempest-VolumeDependencyTests-126835413 None] Lock "cinder-104b4b5d-2e00-45e5-a9a4-552fad3891e4-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=82656) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1395}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Flow 'volume_create_manager' (043e7153-b14a-4a71-9ac8-0ff56440c1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8887618-8819-4889-b338-3b8919b10d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8887618-8819-4889-b338-3b8919b10d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-04-13T09:09:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a178088b-0b03-4f49-a292-9b5c533317e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='96da3dc7bdbb42aab291aefb42b27aba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-04-13T09:09:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=98e3d400-2d41-48c7-87ea-3ac185dfd04a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-04-13T09:09:26Z,use_quota=True,user_id='14f3b5e46a414c089c3eda59031a4396',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9514d0c4-dfc1-47b7-ae12-da2a9dc6195a),volume_type_id=9514d0c4-dfc1-47b7-ae12-da2a9dc6195a)' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b242ed4-a013-4e6c-a72f-7ba527817312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b242ed4-a013-4e6c-a72f-7ba527817312) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133165af-a1ca-4ea5-9b82-72d98dd607cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (133165af-a1ca-4ea5-9b82-72d98dd607cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a178088b-0b03-4f49-a292-9b5c533317e1', 'volume_name': 'volume-a178088b-0b03-4f49-a292-9b5c533317e1', 'volume_size': 1, 'snapshot_id': '98e3d400-2d41-48c7-87ea-3ac185dfd04a'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c039f166-6399-473f-aa77-a2ecd4c79358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c039f166-6399-473f-aa77-a2ecd4c79358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca0ea0e-d9b6-4eaf-9afc-b51f2f7bfe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:26 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Volume a178088b-0b03-4f49-a292-9b5c533317e1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a178088b-0b03-4f49-a292-9b5c533317e1', 'volume_size': 1, 'snapshot_id': '98e3d400-2d41-48c7-87ea-3ac185dfd04a'} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-quobyte-98e3d400-2d41-48c7-87ea-3ac185dfd04a-a178088b-0b03-4f49-a292-9b5c533317e1" by "_create_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-98e3d400-2d41-48c7-87ea-3ac185dfd04a-a178088b-0b03-4f49-a292-9b5c533317e1" acquired by "_create_volume_from_snapshot" :: waited 0.007s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Creating volume a178088b-0b03-4f49-a292-9b5c533317e1 from snapshot 98e3d400-2d41-48c7-87ea-3ac185dfd04a {{(pid=82656) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Selected osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e as target Quobyte volume. {{(pid=82656) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-quobyte-a178088b-0b03-4f49-a292-9b5c533317e1" by "_copy_volume_from_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-a178088b-0b03-4f49-a292-9b5c533317e1" acquired by "_copy_volume_from_snapshot" :: waited 0.006s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] snapshot: 98e3d400-2d41-48c7-87ea-3ac185dfd04a, volume: a178088b-0b03-4f49-a292-9b5c533317e1, {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db7f1a8-cdee-490f-9ff4-0c91f048dcb4]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:26 devstack sudo[90880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a Apr 13 11:09:26 devstack sudo[90880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:26 devstack sudo[90880]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a" returned: 0 in 0.480s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Creating direct copy from snapshot {{(pid=82656) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97de71-e4a5-44cf-96e4-7941eeaefe93]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:26 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:26 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 Apr 13 11:09:26 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:27 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996" returned: 0 in 0.545s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:27 devstack cinder-volume[82656]: DEBUG cinder.utils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Path /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 not found in is_blk_device check {{(pid=82656) is_blk_device /opt/stack/cinder/cinder/utils.py:602}} Apr 13 11:09:27 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:27 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 Apr 13 11:09:27 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:29 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1" returned: 0 in 1.928s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:29 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[267c4b14-0ee3-4160-8fac-3e1dc2cd39b1]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:29 devstack sudo[90903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 Apr 13 11:09:29 devstack sudo[90903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:29 devstack sudo[90903]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996" returned: 0 in 0.604s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:29 devstack cinder-volume[82656]: DEBUG cinder.image.image_utils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Image conversion details: src /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996, size 1024.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 {{(pid=82656) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:533}} Apr 13 11:09:29 devstack cinder-volume[82656]: INFO cinder.image.image_utils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Converted 1024.00 MB image at 530.61 MB/s Apr 13 11:09:29 devstack cinder-volume[82656]: WARNING cinder.volume.drivers.remotefs [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 is being set with open permissions: ugo+rw Apr 13 11:09:29 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:29 devstack sudo[90908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 Apr 13 11:09:29 devstack sudo[90908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:30 devstack sudo[90908]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1" returned: 0 in 0.406s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-a178088b-0b03-4f49-a292-9b5c533317e1" released by "_copy_volume_from_snapshot" :: held 4.029s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-98e3d400-2d41-48c7-87ea-3ac185dfd04a-a178088b-0b03-4f49-a292-9b5c533317e1" released by "_create_volume_from_snapshot" :: held 4.047s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.055s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=293,cinder:SELECT=207,cinder:INSERT=61,cinder:DELETE=26 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:SELECT=192,cinder:UPDATE=267,cinder:DELETE=25,cinder:INSERT=72 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ca0ea0e-d9b6-4eaf-9afc-b51f2f7bfe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a178088b-0b03-4f49-a292-9b5c533317e1', 'volume_size': 1, 'snapshot_id': '98e3d400-2d41-48c7-87ea-3ac185dfd04a'}' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5080913-08a9-4364-820f-588cf1a6a484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}} Apr 13 11:09:30 devstack cinder-volume[82656]: INFO cinder.volume.flows.manager.create_volume [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Volume volume-a178088b-0b03-4f49-a292-9b5c533317e1 (a178088b-0b03-4f49-a292-9b5c533317e1): created successfully Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5080913-08a9-4364-820f-588cf1a6a484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=82656) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Flow 'volume_create_manager' (043e7153-b14a-4a71-9ac8-0ff56440c1af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=82656) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}} Apr 13 11:09:30 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-55f6dbd6-948d-4b8d-86cf-5cc561860a75 tempest-SnapshotDependencyTests-1014945050 None] Created volume successfully. Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-98e3d400-2d41-48c7-87ea-3ac185dfd04a-delete_snapshot" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-98e3d400-2d41-48c7-87ea-3ac185dfd04a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-quobyte-b4fd8b18-4eb8-498f-b949-30f5c16d0996" by "delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-b4fd8b18-4eb8-498f-b949-30f5c16d0996" acquired by "delete_snapshot" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-quobyte-98e3d400-2d41-48c7-87ea-3ac185dfd04a" by "_delete_snapshot" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-98e3d400-2d41-48c7-87ea-3ac185dfd04a" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Deleting offline snapshot 98e3d400-2d41-48c7-87ea-3ac185dfd04a of volume b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] snapshot_file for this snap is: volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a {{(pid=82656) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f161ada-7e43-4c63-a749-18d32d465428]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:30 devstack sudo[90911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a Apr 13 11:09:30 devstack sudo[90911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:30 devstack sudo[90911]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a" returned: 0 in 0.473s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:30 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.remotefs [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=82656) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Apr 13 11:09:31 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a3aea6-f92f-44d2-80a2-71747f50f321]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:31 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 Apr 13 11:09:31 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:31 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996" returned: 0 in 0.468s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:31 devstack sudo[90921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a Apr 13 11:09:31 devstack sudo[90921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:31 devstack sudo[90921]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a" returned: 0 in 0.453s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:31 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:31 devstack sudo[90927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a Apr 13 11:09:31 devstack sudo[90927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:32 devstack sudo[90927]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996.98e3d400-2d41-48c7-87ea-3ac185dfd04a" returned: 0 in 0.401s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-98e3d400-2d41-48c7-87ea-3ac185dfd04a" released by "_delete_snapshot" :: held 1.853s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-b4fd8b18-4eb8-498f-b949-30f5c16d0996" released by "delete_snapshot" :: held 1.870s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Created reservations ['2da2e5b6-6b43-4593-85c9-fcbfbd6a59bd', '52825691-40d7-47d4-ba73-61931846877e', 'eb00d0d9-7bdf-46b9-a0e6-daad3d1eab3d', 'd88a3358-8999-4b2d-8baf-5265d78f8f38'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:32 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Delete snapshot completed successfully. Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-bf0c13ff-adfd-4522-9da3-11d595e404e3 tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-98e3d400-2d41-48c7-87ea-3ac185dfd04a-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-b4fd8b18-4eb8-498f-b949-30f5c16d0996-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-b4fd8b18-4eb8-498f-b949-30f5c16d0996-delete_volume" acquired by "delete_volume" :: waited 0.010s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-quobyte-b4fd8b18-4eb8-498f-b949-30f5c16d0996" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-b4fd8b18-4eb8-498f-b949-30f5c16d0996" acquired by "delete_volume" :: waited 0.009s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b846a20-1bd3-4418-9adb-8a2aca3bbc1b]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:32 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:32 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 Apr 13 11:09:32 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:33 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996" returned: 0 in 0.475s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:33 devstack sudo[90935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996 Apr 13 11:09:33 devstack sudo[90935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:33 devstack sudo[90935]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-b4fd8b18-4eb8-498f-b949-30f5c16d0996" returned: 0 in 0.414s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-b4fd8b18-4eb8-498f-b949-30f5c16d0996" released by "delete_volume" :: held 0.926s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Created reservations ['edec0732-aeed-4dee-b911-cf6c52fa5b09', 'ded2cdc4-dd47-459c-8a0b-f34933cec275', 'a9189171-39c3-4a69-aef8-4aa9ce404c76', 'e5a2372f-4416-4313-8fcc-9f58631c76d0'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:33 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:33 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-a178088b-0b03-4f49-a292-9b5c533317e1-delete_volume" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-a178088b-0b03-4f49-a292-9b5c533317e1-delete_volume" acquired by "delete_volume" :: waited 0.011s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "cinder-quobyte-a178088b-0b03-4f49-a292-9b5c533317e1" by "delete_volume" {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-a178088b-0b03-4f49-a292-9b5c533317e1" acquired by "delete_volume" :: waited 0.013s {{(pid=82656) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b7804-ff6d-4fd4-adb8-921bf9bd0037]: (4, 'qcow2') {{(pid=83533) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:573}} Apr 13 11:09:33 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:33 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 Apr 13 11:09:33 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:34 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.452s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:34 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Deleted volume successfully. Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-42dc303e-e932-4d60-a117-d0e12a38584c tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-b4fd8b18-4eb8-498f-b949-30f5c16d0996-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:34 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1" returned: 0 in 0.510s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:34 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1 Apr 13 11:09:34 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:34 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227/volume-a178088b-0b03-4f49-a292-9b5c533317e1" returned: 0 in 0.424s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-quobyte-a178088b-0b03-4f49-a292-9b5c533317e1" released by "delete_volume" :: held 0.956s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG cinder.quota [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Created reservations ['5801669b-5825-4ccd-8692-18f65d395ef7', '27870808-8103-45d9-af58-278b47aa6a22', 'e3085adb-32ba-4cc3-97e3-40da90cbe574', '08e339b9-c2d2-4900-b6b5-bec93a140153'] {{(pid=82656) reserve /opt/stack/cinder/cinder/quota.py:752}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:34 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:34 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:34 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:35 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:35 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.443s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:35 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:35 devstack cinder-volume[82656]: INFO cinder.volume.manager [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Deleted volume successfully. Apr 13 11:09:35 devstack cinder-volume[82656]: DEBUG cinder.coordination [None req-369f2c16-fd65-43bf-a3cf-6eb68408aace tempest-SnapshotDependencyTests-1014945050 None] Lock "cinder-a178088b-0b03-4f49-a292-9b5c533317e1-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=82656) __release /opt/stack/cinder/cinder/coordination.py:152}} Apr 13 11:09:38 devstack cinder-volume[82656]: DEBUG oslo_service.periodic_task [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82656) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}} Apr 13 11:09:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:506}} Apr 13 11:09:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:519}} Apr 13 11:09:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e': None} {{(pid=82656) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Apr 13 11:09:38 devstack cinder-volume[82656]: DEBUG cinder.volume.drivers.quobyte [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d2a58ffe-9728-498a-b936-71619a0eae8e'] {{(pid=82656) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Apr 13 11:09:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.lockutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.003s {{(pid=82656) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:538}} Apr 13 11:09:38 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:440}} Apr 13 11:09:38 devstack sudo[90955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227 Apr 13 11:09:38 devstack sudo[90955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Apr 13 11:09:39 devstack sudo[90955]: pam_unix(sudo:session): session closed for user root Apr 13 11:09:39 devstack cinder-volume[82656]: DEBUG oslo_concurrency.processutils [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1f1c18e8ae7f759d6ef2c3fa07377227" returned: 0 in 0.574s {{(pid=82656) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:468}} Apr 13 11:09:39 devstack cinder-volume[82656]: DEBUG cinder.manager [None req-04d2d904-0f89-4d7a-a138-f90a57105439 None None] Notifying Schedulers of capabilities ... {{(pid=82656) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}} Apr 13 11:09:44 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=22,cinder:SELECT=16,cinder:INSERT=8 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}} Apr 13 11:09:45 devstack cinder-volume[82656]: DEBUG dbcounter [-] [82656] Writing DB stats cinder:UPDATE=23,cinder:DELETE=3,cinder:SELECT=15,cinder:INSERT=4 {{(pid=82656) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}